---
title: "Run your first test"
section: "Quick Start"
description: "Create a first SmartestQA test by recording or with AI, try it with a dry run on the server or your agent, then run it in a pipeline so it appears in Report."
url: https://docs.smartestqa.ai/en/quick-start-first-test.html
audience: [customer, admin]
updated: 2026-11-07
keywords: "first test record dry run run on server run on your agent pipeline save and execute report"
---
# Quick Start: Run your first test

Create a first test, try it with a dry run, then run it in a pipeline so it shows up in Report.

## In short

**On this page you can**

- Choose one of five routes to a first test, from recording to AI agents.
- Record a web test in Automate with the browser extension.
- Try it with Dry Run on the server or on your agent.
- Run it in a pipeline so it appears in Report .
- Understand why dry run results are not saved to reports.

**How to use it**

1. Open First Test Case in Automate , or click New Test Case .
2. Pick a Start Page URL and environment, click Record and do a short flow.
3. Close the recording tab, name the test case and click Save .
4. Click Dry Run and choose Run on Server or Run on your Agent .
5. In Schedule , add it to a pipeline, click Save & Execute and open Report .

## Create your first test

There are five ways to get a first test. The [setup guide](https://docs.smartestqa.ai/en/quick-start-progress.html#setup-guide) calls them routes; finishing any one of them completes the **Teach your app** step.

| Route | Best for | What you do |
| --- | --- | --- |
| Record it yourself | A first test in minutes; people who know the app | Map pages with [Discover Your App](https://docs.smartestqa.ai/en/discover-your-app.html), then [record a test case in Automate](https://docs.smartestqa.ai/en/automate-add-steps.html#record-web). |
| Write steps with the AI Assistant | Describing a flow in plain language | Create a test case and let the [AI Assistant write its steps](https://docs.smartestqa.ai/en/automate-ai.html#generate-from-prompt). |
| Start from documents or screenshots | Teams with analysis documents or specs | [Upload documents or screenshots in Analyze](https://docs.smartestqa.ai/en/analyze-import.html) and review the generated test cases. |
| Use your code assistant (MCP) | Developers with Claude or another MCP client | [Connect the assistant](https://docs.smartestqa.ai/en/mcp-connect.html) (Test Agents › [**Connect to Claude**](https://docs.smartestqa.ai/en/mcp-connect.html#claude-desktop)), open the code repository and [ask it to build the suite](https://docs.smartestqa.ai/en/mcp-workflows.html#build). |
| Let AI agents explore | Broad first coverage with little effort | [Run an autonomous agent](https://docs.smartestqa.ai/en/ai-agents-runs.html#run-now) and [approve the drafts](https://docs.smartestqa.ai/en/ai-agents-runs.html#proposals) it writes. |

### Record a web test

1. **Open the test case**

   Go to [**Automate**](https://docs.smartestqa.ai/en/automate.html) and open [**First Test Case**](https://docs.smartestqa.ai/en/quick-start-project.html#project-defaults), or click [**New Test Case**](https://docs.smartestqa.ai/en/automate-test-cases.html#create-test-case).
2. **Pick environment and start page**

   Choose a [**Start Page URL**](https://docs.smartestqa.ai/en/quick-start-connect.html#start-page-url) and an [environment](https://docs.smartestqa.ai/en/concepts.html#environments). Without both, recording does not start (“[Please select a Start Page URL.](https://docs.smartestqa.ai/en/quick-start-troubleshooting.html#fix-start-url)”).
3. **Record**

   Click **Record**. Your app opens in a new tab and the [extension](https://docs.smartestqa.ai/en/quick-start-connect.html#install-extension) adds every click, typed value and selection as a [step](https://docs.smartestqa.ai/en/automate-steps-browser.html). Log in and do the flow the way a user would.
4. **Finish and come back**

   Close the recording tab and return to SmartestQA. The steps appear in the list.
5. **Name and save**

   Give the test case a name and click **Save**. You do not have to write a description: [the AI writes one](https://docs.smartestqa.ai/en/automate-ai.html#ai-descriptions) from the steps.

   The test case shows your steps, each one linked to an [action](https://docs.smartestqa.ai/en/discover-actions.html) in [Discover](https://docs.smartestqa.ai/en/discover.html).

> **Tip: Record a short, complete flow first**
>
> Login, open one screen, check one value. Five to ten steps. A short test that passes teaches you more than a long one that fails at step 37.

> **Important: Record with test data only**
>
> Recording saves screenshots of the controls you use, and the values you type are saved in the steps. Use a test user and [test data](https://docs.smartestqa.ai/en/automate-test-data.html). Never record with real customer data or a [personal password](https://docs.smartestqa.ai/en/data-source-secrets.html#where-secrets-belong).

## Run it and read the report

There are two ways to run a test, and only one of them leaves a report.

|  | Dry Run | Pipeline run |
| --- | --- | --- |
| Start it from | **Automate** › [**Dry Run**](https://docs.smartestqa.ai/en/automate-dry-run.html#start-dry-run) | [**Schedule**](https://docs.smartestqa.ai/en/schedule.html): a [pipeline](https://docs.smartestqa.ai/en/schedule-create.html), with **Save & Execute** or a [timer](https://docs.smartestqa.ai/en/schedule-timing.html) |
| Use it for | Trying a test while you build it | Runs you want to keep, share and compare |
| You see | A [live log](https://docs.smartestqa.ai/en/automate-dry-run.html#live-log) while it runs | The live log, then a [full report](https://docs.smartestqa.ai/en/report-summary.html) |
| Saved in Report | No: “Dry Run results are not saved to reports.” | Yes, with [screenshots, video and logs](https://docs.smartestqa.ai/en/report-steps.html) |

![Choosing where a dry run runs.](https://docs.smartestqa.ai/media/shots/QS-SHOT-05.png)

1. **Dry run**

   In Automate click [**Dry Run**](https://docs.smartestqa.ai/en/automate-dry-run.html#start-dry-run) and choose the [run target](https://docs.smartestqa.ai/en/automate-dry-run.html#web-targets): [**Run on Server**](https://docs.smartestqa.ai/en/quick-start-connect.html#agent) (headless, no agent needed) or [**Run on your Agent**](https://docs.smartestqa.ai/en/quick-start-connect.html#agent) (on your computer; you can watch the browser). Watch the live log.
2. **Put it in a pipeline**

   Go to **Schedule**, [create a pipeline](https://docs.smartestqa.ai/en/schedule-create.html#create), give it a name, [add your test case](https://docs.smartestqa.ai/en/schedule-create.html#add-content) and click **Save & Execute**.
3. **Read the report**

   Open [**Report**](https://docs.smartestqa.ai/en/report-list.html#open-a-report). Each run lists its [test cases](https://docs.smartestqa.ai/en/report-summary.html#test-cases-table) and [steps](https://docs.smartestqa.ai/en/report-steps.html#step-table) with status, screenshots, video and logs.

   You have a passing, reported test. The **Run & report** step of the [setup guide](https://docs.smartestqa.ai/en/quick-start-progress.html#setup-guide) is done.
