1. Docs
  2. Administration
  3. Integrations
  4. FAQ, MCP & limits

Integrations: FAQ, MCP & limits

Answers to the questions customers and admins ask about integrations, how AI assistants use them, and the limits that apply.

4 min read Updated CustomersAdmins

In short

On this page you can

  • Find out who can set up integrations and whether each project needs its own.
  • Check what data leaves SmartestQA and where secrets are kept.
  • See what an AI assistant can read and do through smartest_integrations.
  • Look up every limit: webhooks, recipients, metrics, sync sizes, timers.

How to use it

  1. Filter the questions by Customers or Admins.
  2. Open a question; follow its link for the full procedure.
  3. Check the limits table before planning a large sync.
  4. Connect an AI assistant to automate Jira, Xray and mailbox work.

Questions and answers#

Who can set up integrations?Admins

Company Admins. Users do not see Integrations in the menu. Users still benefit: their tasks go to Jira and their runs are announced in Slack. See roles.

Do I have to set up each integration for every project?Customers

Yes. Every integration belongs to one project, so two projects can post to different Slack channels or different Jira projects. Only Active Directory (LDAP) is set for the whole company.

Where are our tokens stored? Can someone read them back?Admins

They are stored encrypted in SmartestQA and never returned to the browser; the form shows “Saved” or dots. Several integrations refuse to send a saved token to a changed address. Use tokens of a technical user with access to one project. See credentials.

What data leaves SmartestQA?Admins

Trackers get task names, descriptions, comments and attachments. Xray and Zephyr get test case names and steps and run results. Confluence gets reports and test case documentation. Chat gets pipeline names, counts and error texts; WhatsApp only names, counts and a link. Webhooks get the JSON in the payload. APM gets run start and end events. Test data values are not sent in messages.

Can SmartestQA reach our on-premises Jira, Azure DevOps Server or Dynatrace Managed?Customers

Yes, if the SmartestQA servers can reach the address. Calls to these systems are made from SmartestQA, not from your agent. Ask IT to allow the SmartestQA servers, or run SmartestQA inside your network. Mail steps are different: they connect from where the test runs.

Can one project post to two Slack channels?Customers

One Slack, one Teams and one WhatsApp setting per project. For more destinations add generic webhooks (up to 20) that point to a service which forwards the event where you need it.

Why don’t I get a message for each failed test?Customers

The Test Failed switch is saved but this version sends no per-test message. A run with any failed test sends Pipeline Failed. See events.

Does Jira Server or Data Center work?Customers

Yes, with Personal Access Token (Server/DC) or Basic Authentication. Xray works only with Xray Cloud. Zephyr Scale works with both Cloud and Data Center. Confluence uses the Cloud API.

Can I use Jira and Azure DevOps in the same project?Customers

Technically yes, and each task would get a ticket in both. Pick one tracker per project to avoid two sources of truth.

Which key should the CI use?Admins

An agent API key, stored as a CI secret. A dedicated agent for CI lets you revoke CI access without touching people’s agents. Runs start with the project access of the key’s user. See CI/CD.

Does the “Send Message To Us” button use our Slack integration?Customers

No. The contact form in the top bar sends your message to the SmartestQA team, whatever integrations you have. You can also write to info@smartestqa.ai.

For AI assistants (MCP)#

An assistant connected through the SmartestQA MCP server uses the smartest_integrations tool. Connections and credentials are set up only on the integration pages; the tool reads them, tests them and carries results out.

SystemActions
Allstatus: which integrations are on; test: test before a sync
Jiradiscover, mappings, stats, issue (by issue key or task), comment, sync (target defect, all, from)
Xraysync (target test, all, from), export of a run’s results to a Test Execution, mappings, stats
Confluencesync (target requirements, report, docs), mappings, stats
Mailmessages, wait, otp, link on the test mailbox

Bulk syncs (target all, and all test case docs) ask the user first. Zephyr, Azure DevOps, chat, webhooks, CI/CD and APM are not driven through MCP; they work on their own once set up. Connect an assistant from Device FarmTest AgentsConnect to Claude.

Example prompts
Is Jira on for project "Customer Portal"? Test the connection, then show the tasks that have no Jira issue yet.

Export the results of last night's "Nightly regression" run to Xray.

Wait for the password reset email in the test mailbox and give me the link.

Limits#

ItemLimit
Jira: issues imported by one Get from Jira200 newest unlinked
Jira: timed sync interval1–24 hours (checked every 15 minutes)
Azure DevOps: timed sync interval15 minutes–24 hours (checked every 5 minutes)
Azure DevOps: attachments per sync10, each up to 60 MB
Azure DevOps / Zephyr: runs listed on the pageLast 20
Xray: Tests read by one Pull from Xray100
Zephyr: test cases per import5,000
Zephyr: description length kept1,000 characters
Zephyr / Confluence: a sync blocks the next one for at most45 / 60 minutes
WhatsApp recipients20
Webhooks per project20
Webhook custom headers10
Webhook attempts / deliveries kept4 / 50
APM watched metrics per connection20
APM report window24 hours
CI step timeout1–1440 minutes (60 by default)
CI status checksEvery 15 seconds; gives up after 5 failures in a row
Daily summaryOnce a day per channel, on the hour
Slack, Teams, WhatsApp settings per projectOne each

Didn’t find your answer?Write to support with your project name and what you see on screen.

info@smartestqa.ai
© 2026 Selenity Technology · SmartestQAsmartestqa.aiThis page as MarkdownChecked against smarttest-fe predev 2a8c79cc, smarttest-be 633c2a03, smartest-mcp-server src/next/integrations.ts and src/integrations.ts