- Docs
- Administration
- Integrations
- FAQ, MCP & limits
Integrations: FAQ, MCP & limits
Answers to the questions customers and admins ask about integrations, how AI assistants use them, and the limits that apply.
In short
On this page you can
- Find out who can set up integrations and whether each project needs its own.
- Check what data leaves SmartestQA and where secrets are kept.
- See what an AI assistant can read and do through
smartest_integrations. - Look up every limit: webhooks, recipients, metrics, sync sizes, timers.
How to use it
- Filter the questions by Customers or Admins.
- Open a question; follow its link for the full procedure.
- Check the limits table before planning a large sync.
- Connect an AI assistant to automate Jira, Xray and mailbox work.
Questions and answers#
Who can set up integrations?Admins
Company Admins. Users do not see Integrations in the menu. Users still benefit: their tasks go to Jira and their runs are announced in Slack. See roles.
Do I have to set up each integration for every project?Customers
Yes. Every integration belongs to one project, so two projects can post to different Slack channels or different Jira projects. Only Active Directory (LDAP) is set for the whole company.
Where are our tokens stored? Can someone read them back?Admins
They are stored encrypted in SmartestQA and never returned to the browser; the form shows “Saved” or dots. Several integrations refuse to send a saved token to a changed address. Use tokens of a technical user with access to one project. See credentials.
What data leaves SmartestQA?Admins
Trackers get task names, descriptions, comments and attachments. Xray and Zephyr get test case names and steps and run results. Confluence gets reports and test case documentation. Chat gets pipeline names, counts and error texts; WhatsApp only names, counts and a link. Webhooks get the JSON in the payload. APM gets run start and end events. Test data values are not sent in messages.
Can SmartestQA reach our on-premises Jira, Azure DevOps Server or Dynatrace Managed?Customers
Yes, if the SmartestQA servers can reach the address. Calls to these systems are made from SmartestQA, not from your agent. Ask IT to allow the SmartestQA servers, or run SmartestQA inside your network. Mail steps are different: they connect from where the test runs.
Can one project post to two Slack channels?Customers
One Slack, one Teams and one WhatsApp setting per project. For more destinations add generic webhooks (up to 20) that point to a service which forwards the event where you need it.
Why don’t I get a message for each failed test?Customers
The Test Failed switch is saved but this version sends no per-test message. A run with any failed test sends Pipeline Failed. See events.
Does Jira Server or Data Center work?Customers
Yes, with Personal Access Token (Server/DC) or Basic Authentication. Xray works only with Xray Cloud. Zephyr Scale works with both Cloud and Data Center. Confluence uses the Cloud API.
Can I use Jira and Azure DevOps in the same project?Customers
Technically yes, and each task would get a ticket in both. Pick one tracker per project to avoid two sources of truth.
Which key should the CI use?Admins
An agent API key, stored as a CI secret. A dedicated agent for CI lets you revoke CI access without touching people’s agents. Runs start with the project access of the key’s user. See CI/CD.
Does the “Send Message To Us” button use our Slack integration?Customers
No. The contact form in the top bar sends your message to the SmartestQA team, whatever integrations you have. You can also write to info@smartestqa.ai.
For AI assistants (MCP)#
An assistant connected through the SmartestQA MCP server uses the smartest_integrations tool. Connections and credentials are set up only on the integration pages; the tool reads them, tests them and carries results out.
| System | Actions |
|---|---|
| All | status: which integrations are on; test: test before a sync |
| Jira | discover, mappings, stats, issue (by issue key or task), comment, sync (target defect, all, from) |
| Xray | sync (target test, all, from), export of a run’s results to a Test Execution, mappings, stats |
| Confluence | sync (target requirements, report, docs), mappings, stats |
messages, wait, otp, link on the test mailbox |
Bulk syncs (target all, and all test case docs) ask the user first. Zephyr, Azure DevOps, chat, webhooks, CI/CD and APM are not driven through MCP; they work on their own once set up. Connect an assistant from Device FarmTest AgentsConnect to Claude.
Is Jira on for project "Customer Portal"? Test the connection, then show the tasks that have no Jira issue yet.
Export the results of last night's "Nightly regression" run to Xray.
Wait for the password reset email in the test mailbox and give me the link.Limits#
| Item | Limit |
|---|---|
| Jira: issues imported by one Get from Jira | 200 newest unlinked |
| Jira: timed sync interval | 1–24 hours (checked every 15 minutes) |
| Azure DevOps: timed sync interval | 15 minutes–24 hours (checked every 5 minutes) |
| Azure DevOps: attachments per sync | 10, each up to 60 MB |
| Azure DevOps / Zephyr: runs listed on the page | Last 20 |
| Xray: Tests read by one Pull from Xray | 100 |
| Zephyr: test cases per import | 5,000 |
| Zephyr: description length kept | 1,000 characters |
| Zephyr / Confluence: a sync blocks the next one for at most | 45 / 60 minutes |
| WhatsApp recipients | 20 |
| Webhooks per project | 20 |
| Webhook custom headers | 10 |
| Webhook attempts / deliveries kept | 4 / 50 |
| APM watched metrics per connection | 20 |
| APM report window | 24 hours |
| CI step timeout | 1–1440 minutes (60 by default) |
| CI status checks | Every 15 seconds; gives up after 5 failures in a row |
| Daily summary | Once a day per channel, on the hour |
| Slack, Teams, WhatsApp settings per project | One each |
Didn’t find your answer?Write to support with your project name and what you see on screen.
info@smartestqa.ai