---
title: "How do I sync automated test results with Xray or Zephyr Scale?"
section: "Use cases"
description: "Sync SmartestQA with Xray or Zephyr Scale: connect the tool in Integrations, link test cases in both directions, write pipeline results to a Zephyr test cycle after each run, and export run results to an Xray Test Execution. Editions, limits and status mapping."
url: https://docs.smartestqa.ai/en/use-case-test-management-sync.html
audience: [customer, admin]
updated: 2026-11-12
keywords: "xray integration zephyr scale integration sync automated test results test management test execution test cycle jira test management send test cases to xray pull from xray get from zephyr send to zephyr write pipeline results passed failed status mapping xray cloud zephyr data center requirements from jira traceability confluence report update test results by hand in jira upload script for test results automatic zephyr results xray export on request link automated tests to test management"
---
# Use cases: How do I sync automated test results with Xray or Zephyr Scale?

An Admin connects Xray or Zephyr Scale on its page in SmartestQA Integrations and syncs the test cases, because only linked test cases get results. Zephyr Scale then receives a new test cycle with the results after each pipeline run; Xray receives a Test Execution when an export of a run is requested.

## In short

**On this page you can**

- Write pipeline results to a Zephyr Scale test cycle after each run.
- Export a run's results to Xray as a Test Execution.
- Send SmartestQA test cases to Xray or Zephyr Scale.
- Bring Xray Tests and Zephyr test cases into SmartestQA.
- Bring Jira issues linked in Zephyr into Analyze as requirements.

**How to use it**

1. Open Integrations , choose Xray or Zephyr Scale and click Setup .
2. Enter the credentials and the Jira project key, then click Test Connection .
3. Choose the directions and click Save .
4. Link the test cases: Send to Xray or Pull from Xray ; Get from Zephyr or Send to Zephyr .
5. Run a pipeline and check the test cycle in Zephyr, or export the run to Xray.

## The short answer

Both tools are connected per project under **Configuration** › [**Integrations**](https://docs.smartestqa.ai/en/integrations.html#catalogue) by a Company Admin, and both work on **linked test cases**: a result is written only for a test case that is mapped to an Xray Test or linked to a Zephyr test case. So the order is always: connect, sync the test cases, then run.

The two differ in how results travel. **Zephyr Scale**: with **Write pipeline results to Zephyr** on, linked test cases get a result in a new test cycle after each pipeline, automatically. **Xray**: results of mapped test cases are sent as a Test Execution, but in this version an export runs when it is requested, by an AI assistant connected through MCP. The **Automatic Export** line on the Xray page does not start an export by itself.

## The problem this solves

Many teams keep their test cases in a test management tool inside Jira, because that is where managers and auditors look for the test status. The automated tests run somewhere else. After a run, someone opens the tool and sets each test to passed or failed by hand, or the team writes a script that maps result files to test keys and uploads them. The hand-kept status often falls behind, and the script needs care each time a test is renamed or a key is missing.

What is missing is a link between each automated test case and its entry in the tool, kept in one place, so that a result lands on the right test without a mapping file in between.

## An example

This is an illustration, not a customer story. A bank has two test teams, each with its own SmartestQA project and its own Jira project: the online banking team uses Zephyr Scale, the cards team uses Xray.

1. The Admin of the online banking project connects Zephyr Scale, keeps **Write pipeline results to Zephyr** on and clicks [**Send to Zephyr**](https://docs.smartestqa.ai/en/integrations-test-management.html#zephyr-sync). The automated test cases written in SmartestQA are sent and get the label `SmartestQA`.
2. The nightly pipeline runs. Afterwards Zephyr holds a new test cycle named `SmartestQA · Nightly regression ·` plus the date and time, with Pass or Fail for each linked test case. Nobody asked for it.
3. On the Zephyr page the panel **Results written to Zephyr** lists the run with its **Status**. A failed write would show **Retry**.
4. The Admin of the cards project connects Xray with **Execution Results** chosen and clicks [**Send to Xray**](https://docs.smartestqa.ai/en/integrations-test-management.html#xray-sync). The links appear in the **Mappings** table.
5. Their nightly pipeline runs too, and nothing appears in Xray by itself. In the morning a tester asks an AI assistant connected through MCP: “Export the results of last night's "Nightly regression" run to Xray.” Xray gets a Test Execution with PASSED or FAILED per mapped test and up to three error messages in the comment.
6. A test case added yesterday is not mapped yet, so it is not in the Test Execution. The tester clicks **Send to Xray** before the next export.

The Zephyr team no longer touches results. The Xray team replaced typing results with one request per run, which someone still has to make.

## By hand, with your own upload script, and with SmartestQA

| Question | Results entered by hand | Your own upload script | SmartestQA |
| --- | --- | --- | --- |
| How is a test tied to its entry in the tool? | By name, by the person who enters the result | By a key in the test code or a mapping file you maintain | By a link made with [**Send to Xray**](https://docs.smartestqa.ai/en/integrations-test-management.html#xray-sync) or [**Pull from Xray**](https://docs.smartestqa.ai/en/integrations-test-management.html#xray-sync), [**Send to Zephyr**](https://docs.smartestqa.ai/en/integrations-test-management.html#zephyr-sync) or [**Get from Zephyr**](https://docs.smartestqa.ai/en/integrations-test-management.html#zephyr-sync) |
| Who writes the results to Zephyr Scale? | A person, after the run | The script, when the CI job calls it | SmartestQA, automatically after each pipeline, in a new test cycle, while **Write pipeline results to Zephyr** is on |
| Who writes the results to Xray? | A person, after the run | The script, when the CI job calls it | Only on request: an AI assistant connected through MCP exports the run as a Test Execution. The **Automatic Export** line does not start an export by itself |
| What happens to a test that is not linked? | The person notices, or it is left out | The upload skips it or fails, as coded | It gets no result. Only linked test cases are written |
| What if a write fails? | The person tries again | You read the CI log and run it again | Zephyr: the panel **Results written to Zephyr** lists the last 20 runs, with **Retry** on failed writes |

## Steps

1. **Get the credentials**

   Xray Cloud: in Global Settings › API Keys create a key for a technical user; you get a Client ID and a Client Secret. Zephyr Scale on Jira Cloud: a Zephyr API access token and the region (US or EU). Zephyr Scale on Jira Data Center: a Jira personal access token and the Jira address. Note the Jira project key. See [Xray: before you start](https://docs.smartestqa.ai/en/integrations-test-management.html#xray-before) and [Zephyr Scale: before you start](https://docs.smartestqa.ai/en/integrations-test-management.html#zephyr-before).
2. **Connect Xray**

   Open **Integrations** › **Xray** and click **Setup**. Keep **Xray Cloud URL**, enter **Client ID** and **Client Secret** and click **Test Connection**. Then enter the **Jira Project Key** and choose the **Default Test Type**: Manual, Cucumber (BDD) or Generic. Under **Sync Direction** choose **Test Case → Xray**, **Xray → Test Case** and **Execution Results**, and click **Save**.

   “Settings saved successfully”, and the page shows Active.
3. **Or connect Zephyr Scale**

   Open **Integrations** › **Zephyr Scale** and click **Setup**. Pick **Where Zephyr runs**, then the region or the Jira address, the **Jira project key** and the token. Click **Test Connection**. Three switches are on by default: **Bring linked Jira issues to Analyze**, **Send test cases written in SmartestQA to Zephyr** and **Write pipeline results to Zephyr**. Set **Status for passed** and **Status for failed** to the names in your Zephyr (Pass and Fail by default) and click **Save**.

   **Connected** with the project name.
4. **Link the test cases**

   Xray: click [**Send to Xray**](https://docs.smartestqa.ai/en/integrations-test-management.html#xray-sync) (“Synchronization started. Test cases are being sent to Xray...”) or [**Pull from Xray**](https://docs.smartestqa.ai/en/integrations-test-management.html#xray-sync); the links appear in the **Mappings** table. Zephyr: click [**Get from Zephyr**](https://docs.smartestqa.ai/en/integrations-test-management.html#zephyr-sync) (“Started — this page updates when it finishes.”) or [**Send to Zephyr**](https://docs.smartestqa.ai/en/integrations-test-management.html#zephyr-sync). See [What each Xray sync does](https://docs.smartestqa.ai/en/integrations-test-management.html#xray-sync) and [What each Zephyr direction does](https://docs.smartestqa.ai/en/integrations-test-management.html#zephyr-sync).
5. **Run a pipeline**

   Run the pipeline that holds the linked test cases, by hand, on its schedule or from CI. See [Run, stop & follow](https://docs.smartestqa.ai/en/schedule-runs.html).
6. **Check the result in Zephyr**

   Zephyr gets a new test cycle named `SmartestQA · pipeline · yyyy-MM-dd HH:mm` (on Data Center: a test run). Each run is written once. The panel **Results written to Zephyr** lists the last 20 runs with **Pipeline**, **Results**, **Status** and **Retry** on failed writes.
7. **Export the run to Xray**

   Ask an AI assistant connected through MCP, for example: “Export the results of last night's "Nightly regression" run to Xray.” The assistant exports by pipeline, run or test log. Only test cases mapped to Xray are included. See [Test execution results](https://docs.smartestqa.ai/en/integrations-test-management.html#xray-results) and [For AI assistants (MCP)](https://docs.smartestqa.ai/en/integrations-faq.html#mcp).

## Xray and Zephyr Scale side by side

Source: [Xray and Zephyr Scale](https://docs.smartestqa.ai/en/integrations-test-management.html) and the [limits](https://docs.smartestqa.ai/en/integrations-faq.html#limits).

|  | Xray | Zephyr Scale |
| --- | --- | --- |
| Editions | Xray Cloud | Jira Cloud (US or EU region) and Jira Data Center |
| Credentials | Client ID and Client Secret | Zephyr API access token (Cloud) or Jira personal access token (Data Center) |
| Test cases in | [**Pull from Xray**](https://docs.smartestqa.ai/en/integrations-test-management.html#xray-sync), up to 100 Tests | [**Get from Zephyr**](https://docs.smartestqa.ai/en/integrations-test-management.html#zephyr-sync), up to 5,000 cases, as planned scenarios |
| Test cases out | [**Send to Xray**](https://docs.smartestqa.ai/en/integrations-test-management.html#xray-sync): every test case | [**Send to Zephyr**](https://docs.smartestqa.ai/en/integrations-test-management.html#zephyr-sync): automated test cases written in SmartestQA |
| Requirements | No | Linked Jira issues become requirements |
| Run results | Exported on request, as a Test Execution | Automatically after each pipeline, in a new test cycle |
| Timed sync | None in this version; use the two buttons | None; results follow pipeline runs, imports and exports run when you click their button |
| Remove | **Remove** deletes all mappings; Tests in Xray and test cases in SmartestQA stay | **Remove** deletes the connection and its settings; imported test cases and requirements stay |

## How a SmartestQA result is written

| SmartestQA result | Xray status |
| --- | --- |
| Passed (passed, success, completed) | PASSED |
| Failed (failed, error) | FAILED |
| Running | EXECUTING |
| Anything else | TODO |

In Xray the execution comment lists up to three error messages. In Zephyr Scale a passed test case gets the name in **Status for passed** and a failed one the name in **Status for failed**: Pass and Fail by default. If you change the status names in Zephyr, update these two fields.

## What you get

- **A Zephyr test cycle per pipeline run.** Named `SmartestQA · pipeline · yyyy-MM-dd HH:mm`, with a result for each linked test case. Each run is written once.
- **An Xray Test Execution per exported run.** With PASSED, FAILED, EXECUTING or TODO per test and up to three error messages in the comment.
- **Test cases in both tools.** [**Send to Xray**](https://docs.smartestqa.ai/en/integrations-test-management.html#xray-sync) creates a Test named `[SmartestQA-TCid] name` with one Xray step per SmartestQA step. [**Send to Zephyr**](https://docs.smartestqa.ai/en/integrations-test-management.html#zephyr-sync) adds the label `SmartestQA`.
- **Existing cases as a plan.** Each Zephyr test case becomes a planned scenario tagged `planned` and `zephyr`; the first folder level becomes the module. Running the import again only updates cases that changed.
- **Requirements from Jira.** With **Bring linked Jira issues to Analyze** on, each linked issue becomes a sub-requirement under its epic or parent, and the scenario is linked to it.
- **Clear ownership.** Test cases that came from Zephyr stay owned by Zephyr: their name and steps are never written back. Tests that SmartestQA created in Xray are skipped by [**Pull from Xray**](https://docs.smartestqa.ai/en/integrations-test-management.html#xray-sync).
- **Counters on the page.** Xray shows **Mapped Tests**, **Successful Syncs** and Failed; Zephyr shows **Test cases from Zephyr**, **Test cases sent to Zephyr**, **Requirements from Jira** and **Runs written to Zephyr**.

## Questions and answers

### Q: Are test results sent to Xray and Zephyr automatically after every run?

To Zephyr Scale, yes: with **Write pipeline results to Zephyr** on, linked test cases get a result in a new test cycle after each pipeline. To Xray, an export runs when it is requested through an AI assistant connected to SmartestQA by MCP; the **Automatic Export** line does not start one by itself. See [Test execution results](https://docs.smartestqa.ai/en/integrations-test-management.html#xray-results).

_Audience: customer, admin_

### Q: Does it work with Xray Server or Data Center?

No. In SmartestQA, Xray works only with Xray Cloud. Zephyr Scale works with both Jira Cloud and Jira Data Center. See [Does Jira Server or Data Center work?](https://docs.smartestqa.ai/en/integrations-faq.html#faq-jira-cloud-server)

_Audience: customer, admin_

### Q: Why does no Test Execution appear in Xray after a run?

Either no export was requested, or the run holds no mapped test case. Only test cases mapped to Xray are included, so sync them first; a run with none returns “No Xray mappings found for tests in this log”. See [No Test Execution appears in Xray after a run](https://docs.smartestqa.ai/en/integrations-troubleshooting.html#fix-xray-no-execution).

_Audience: customer, admin_

### Q: Why was nothing written to Zephyr for my run?

Results are written only for test cases linked to Zephyr, and only while **Write pipeline results to Zephyr** is on; with the switch off the panel reads “Writing results is turned off.” Link the cases with [**Get from Zephyr**](https://docs.smartestqa.ai/en/integrations-test-management.html#zephyr-sync) or [**Send to Zephyr**](https://docs.smartestqa.ai/en/integrations-test-management.html#zephyr-sync) first. See [“No test case in this run is linked to Zephyr”](https://docs.smartestqa.ai/en/integrations-troubleshooting.html#fix-zephyr-no-link).

_Audience: customer, admin_

### Q: How many test cases can I import from Xray or Zephyr?

One [**Pull from Xray**](https://docs.smartestqa.ai/en/integrations-test-management.html#xray-sync) reads up to 100 Tests of the Jira project. One Zephyr import takes up to 5,000 test cases, and descriptions are cut at 1,000 characters. See [Limits](https://docs.smartestqa.ai/en/integrations-faq.html#limits).

_Audience: customer, admin_

### Q: Do I need the Jira integration for Zephyr Scale?

For test cases and results, no. For requirements on Jira Cloud, yes: linked issues are read through the project’s Jira integration, so set up Jira first. See [“Requirements were not imported: Zephyr Cloud needs the Jira integration…”](https://docs.smartestqa.ai/en/integrations-troubleshooting.html#fix-zephyr-requirements)

_Audience: customer, admin_

### Q: Will a sync overwrite the test cases in my test management tool?

Test cases that came from Zephyr stay owned by Zephyr: SmartestQA never writes their name and steps back. [**Send to Xray**](https://docs.smartestqa.ai/en/integrations-test-management.html#xray-sync) updates the Tests that are already mapped and creates new ones for the rest. Decide which tool owns each test case before the first sync. See [Best practices](https://docs.smartestqa.ai/en/integrations-test-management.html#best-practices).

_Audience: customer, admin_

### Q: Can I use Xray and Zephyr Scale in the same project?

Do not connect Xray and Zephyr to the same Jira project from one SmartestQA project. Every integration belongs to one project. See [Do I have to set up each integration for every project?](https://docs.smartestqa.ai/en/integrations-faq.html#faq-per-project)

_Audience: customer, admin_

### Q: What does “Another sync is still running” mean?

Only one Zephyr import or export runs at a time per project, and a second click returns this message. A job that has not finished after 45 minutes no longer blocks new ones. See [“Another sync is still running”](https://docs.smartestqa.ai/en/integrations-troubleshooting.html#fix-sync-running).

_Audience: customer, admin_

### Q: Can run reports also go to Confluence?

Yes. With the Confluence integration, **Test Reports Sync** and [**Auto-Create Report Pages**](https://docs.smartestqa.ai/en/integrations-confluence.html#what-is-sent) on, SmartestQA creates one report page for each pipeline run that finishes, under the reports parent page. [**Send Report**](https://docs.smartestqa.ai/en/integrations-confluence.html#what-is-sent) publishes every finished run that has no page yet. See [What is sent and when](https://docs.smartestqa.ai/en/integrations-confluence.html#what-is-sent).

_Audience: customer, admin_

## Read more

- [Xray and Zephyr Scale](https://docs.smartestqa.ai/en/integrations-test-management.html): set-up, each sync direction, results and removal.
- [Xray and Zephyr counters](https://docs.smartestqa.ai/en/integrations-numbers.html#test-mgmt-kpis): how the numbers on the pages are counted.
- [Integrations FAQ](https://docs.smartestqa.ai/en/integrations-faq.html): limits, data that leaves SmartestQA, and MCP.
- [How credentials are handled](https://docs.smartestqa.ai/en/integrations.html#secrets): tokens are stored encrypted and never shown again.
- [Confluence](https://docs.smartestqa.ai/en/integrations-confluence.html): publish run reports and test case documentation as pages.
- [Jira](https://docs.smartestqa.ai/en/integrations-issue-trackers.html#jira): the integration Zephyr Cloud needs for requirements.
- [How do I prove every requirement is tested?](https://docs.smartestqa.ai/en/use-case-coverage.html): what the imported requirements are used for.
