---
title: "Where a pipeline runs"
section: "Schedule"
description: "Choose where a SmartestQA pipeline runs: Run on Server with automatic or specific servers, Run on Your Agent, mobile device farms, desktop agents, and DEV/TEST/PRP."
url: https://docs.smartestqa.ai/en/schedule-where.html
audience: [customer, admin]
updated: 2026-11-08
keywords: "run environment run on server run on your agent server automatic specific server dedicated shared pool queue test agent list device farm aws browserstack desktop agent environment dev test prp start page url"
---
# Schedule: Where a pipeline runs

Two choices decide where a pipeline’s tests happen: the Run Environment (which machine executes them) and, for web, the start page and environment (which address of your app they open).

## In short

**On this page you can**

- Run web tests headless on SmartestQA servers with Run on Server .
- Pin a run to one server with A specific server , or leave Automatic (recommended) .
- Run on one or more of your own machines with Run on Your Agent .
- Send mobile runs to your agent, SmartTest Device Farm, AWS Device Farm or BrowserStack.
- Pick the start page and DEV , TEST or PRP for web runs.

**How to use it**

1. Open the pipeline’s Schedule tab and find Run Environment .
2. Choose server or agent; for agents tick hosts with a green dot in Test Agent List .
3. Web: choose the start page and Environment above the dates.
4. Save, run, and read the queue message if the run waits for a server.

## Run Environment

**Run Environment** is on the Schedule tab, under the dates. The options depend on the project type.

| Project type | Options | Notes |
| --- | --- | --- |
| WEB | [**Run on Server**](https://docs.smartestqa.ai/en/quick-start-connect.html#agent) · **Run on Your Agent** | Server adds the [Server](https://docs.smartestqa.ai/en/schedule-where.html#server-choice) choice; agent adds the [Test Agent List](https://docs.smartestqa.ai/en/schedule-where.html#agent). |
| MOBILE (Android, iOS) | Your Agent · SmartTest Device Farm · AWS Device Farm · BrowserStack | SmartTest Device Farm appears only with the [add-on](https://docs.smartestqa.ai/en/agent-pool.html#request-access). See [Mobile](https://docs.smartestqa.ai/en/schedule-where.html#mobile). |
| DESKTOP | **Run on Your Agent** only | See [Desktop](https://docs.smartestqa.ai/en/schedule-where.html#desktop). |

### Which one to choose

| Your situation | Choose |
| --- | --- |
| Web app reachable from the internet, nightly or CI runs | [**Run on Server**](https://docs.smartestqa.ai/en/quick-start-connect.html#agent), **Automatic (recommended)** |
| Web app behind a VPN, firewall or on an intranet | **Run on Your Agent** on a machine inside that network, or a specific server set up for it |
| Steps that query your database, read a mailbox or call an internal API | A machine that can reach them: [database](https://docs.smartestqa.ai/en/automate-steps-database.html), [mail](https://docs.smartestqa.ai/en/automate-steps-mail.html) and [API steps](https://docs.smartestqa.ai/en/automate-steps-api.html) connect from where the run executes |
| Same tests on several machines or browsers at once | **Run on Your Agent** with several agents ticked |
| Phone or emulator on your desk | Your Agent (mobile, [local setup](https://docs.smartestqa.ai/en/agent-pool-local-setup.html#android-emulator)) |
| Real devices without owning them | [SmartTest Device Farm](https://docs.smartestqa.ai/en/project-settings-mobile.html#device-farm), [AWS Device Farm](https://docs.smartestqa.ai/en/project-settings-mobile.html#aws) or [BrowserStack](https://docs.smartestqa.ai/en/project-settings-mobile.html#browserstack) |
| Desktop application (Windows or macOS) | Run on Your Agent, on the [Windows machine](https://docs.smartestqa.ai/en/agent-pool-local-setup.html#windows-desktop) or [Mac](https://docs.smartestqa.ai/en/agent-pool-local-setup.html#macos-desktop) with the app |

## Run on Server

The run executes headless (no visible browser) on a SmartestQA server. You install nothing and no machine of yours has to stay on. The server must be able to reach your app’s address; it reaches the internet, not your internal network.

If your firewall only lets known addresses in, an Admin finds SmartestQA’s outgoing addresses under **Our egress IPs** in [Company Settings › Network & capacity](https://docs.smartestqa.ai/en/company-settings-network.html#egress) and asks IT to allow them.

### Server: automatic or a specific server

With [**Run on Server**](https://docs.smartestqa.ai/en/quick-start-connect.html#agent) selected, a **Server** choice appears.

![The Server choice under Run on Server.](https://docs.smartestqa.ai/media/shots/SCH-SHOT-06.png)

| Option | What happens |
| --- | --- |
| **Automatic (recommended)** | “The first free server in the shared pool takes the run.” If your company has [dedicated servers](https://docs.smartestqa.ai/en/company-settings-network.html#dedicated): “First your company’s dedicated servers (*n*), then the shared pool if they are full.” |
| **A specific server** | “For an environment behind a VPN or a special setup. The run executes only on that server.” Pick it in **Choose server**; each entry shows name, usage (Dedicated, Dedicated · Self-hosted), slots in use and status (Online, Full, Paused, Offline, Disabled). With none available: “No server is open to your company yet.” |

A live line under the choice shows the current load, for example “Now: Shared pool 3/8 slots in use, 0 of your runs waiting.” or, for a specific server, “Now: build-eu-1 2/2 slots in use. If it is full the run waits for it and does not move to another server.” How to read it: [Queue numbers](https://docs.smartestqa.ai/en/schedule-numbers.html#queue-message).

### When a run waits for a server

A server runs a limited number of pipeline runs at once (its **slots**). When all slots are busy, your run waits in a queue instead of failing. Starting it shows, instead of “execution started successfully”:

- “Queued · next in line for your company · pool 8/8”
- “Queued · 2 run(s) of your company ahead · pool 8/8”
- “Sent to a server · starting”

[Report](https://docs.smartestqa.ai/en/report-list.html#live-updates) opens on the run with a band: “Next in line for your company” or “*n* run(s) of your company are ahead”, then “Waiting 01:20 · pool 8/8 · the report opens automatically when the run starts.” **Remove from queue** takes the run out (“"*name*" will be removed from the queue and will not run.”). [**Stop run**](https://docs.smartestqa.ai/en/schedule-runs.html#stop) on the pipeline also removes its waiting runs.

Who goes first when a slot frees up:

1. **Priority by source:** a sub-pipeline of a run that is already going, then runs started by hand, then [CI/CD API runs](https://docs.smartestqa.ai/en/schedule-runs.html#cli), then [scheduled runs](https://docs.smartestqa.ai/en/schedule-timing.html), then [RPA queue items](https://docs.smartestqa.ai/en/schedule-triggers-queues.html#queue-items).
2. **Fair share:** among equal priority, the company with the fewest runs going at that moment.
3. **First come, first served** after that.

- A waiting run never times out; it runs when its turn comes.
- Dedicated servers serve only their companies. If they are full or offline, the run moves to the shared pool after 30 seconds, when your company allows it; otherwise it waits for them.
- Your company may have a limit of concurrent runs in the shared pool. Admins see it, with dedicated servers, running and waiting runs, in [Company Settings › Network & capacity](https://docs.smartestqa.ai/en/company-settings-network.html#kpis). SmartestQA sets the limit; ask [info@smartestqa.ai](mailto:info@smartestqa.ai) to change it.
- You never see a global position: the queue is fair between companies, so the message counts only your company’s runs ahead of yours.

## Run on Your Agent

The run executes on a computer you control, with the [SmartestQA agent](https://docs.smartestqa.ai/en/agent-pool-agents.html) installed and online. Use it for apps the internet cannot reach, for mobile devices on your desk, for desktop apps, and when you want to watch the browser (turn off [**Headless Mode**](https://docs.smartestqa.ai/en/project-settings-test-management.html#browser) in [Test Management](https://docs.smartestqa.ai/en/schedule-settings.html#test-management)).

1. **Select Run on Your Agent**

   The [**Test Agent List**](https://docs.smartestqa.ai/en/agent-pool-agents.html#agent-list) appears, with your own host already ticked.
2. **Tick the agents**

   Each host shows a dot: green online, red offline. (On the [Test Agents](https://docs.smartestqa.ai/en/agent-pool-agents.html#agent-status) page the same offline agent has a grey dot.) Tick one or more.
3. **Save and run**

   Every ticked agent must be online when the run starts.

   Each ticked agent runs the whole pipeline. Two agents ticked means two runs of every case.

- Not installed yet? [Install an agent](https://docs.smartestqa.ai/en/quick-start-connect.html#install-agent). When a host counts as online: [the 90-second rule](https://docs.smartestqa.ai/en/quick-start-connect.html#agent-online-rule).
- Only hosts you have access to work. Saving drops ticked hosts you cannot use; if none is left, or a run starts with one, you get “Selected host is not accessible…” ([fix](https://docs.smartestqa.ai/en/schedule-troubleshooting.html#fix-host-not-accessible)). With no host ticked at all: “Please select at least 1 host…”.
- For nightly schedules use a machine that stays on, such as a VM, not a laptop.

## Mobile projects

| Option | Runs on | Set up in |
| --- | --- | --- |
| Your Agent | A phone or emulator connected to your agent’s computer, through [Appium](https://docs.smartestqa.ai/en/agent-pool-local-setup.html) | [Device Farm › Test Agents](https://docs.smartestqa.ai/en/agent-pool-agents.html#agent-list); ticked hosts in [**Test Agent List**](https://docs.smartestqa.ai/en/agent-pool-agents.html#agent-list); the device in **Connected Device** on the pipeline’s **Mobile Settings** tab |
| SmartTest Device Farm | SmartestQA’s [device farm](https://docs.smartestqa.ai/en/agent-pool.html) (add-on) | The pipeline’s [**Mobile Settings** tab](https://docs.smartestqa.ai/en/schedule-settings.html#mobile-desktop-load): choose devices and the app per platform. Without a choice: “No device selected — auto-picked per platform.” |
| AWS Device Farm | Devices in your AWS Device Farm account | [Configuration › Project Panel › Mobile Config](https://docs.smartestqa.ai/en/project-settings-mobile.html#aws). The device list is the project’s, the same for every pipeline. |
| BrowserStack | Devices in your BrowserStack account | [Configuration › Project Panel › Mobile Config](https://docs.smartestqa.ai/en/project-settings-mobile.html#browserstack). The device list is the project’s, the same for every pipeline. |

- In a MOBILE project (Android and iOS in one project), **Target Platforms** chooses Android, iOS or both for this pipeline. At least one stays ticked.
- With SmartTest Device Farm, every ticked platform needs an [app](https://docs.smartestqa.ai/en/agent-pool-app-library.html#use-in-runs): “Select an app for every selected target platform — Mobile Settings → SmartTest Device Farm”.
- The **Mobile Settings** tab also shows the AWS Device Farm and BrowserStack fields, but it does not save them: change those devices in [Mobile Config](https://docs.smartestqa.ai/en/project-settings-mobile.html). Your Agent and SmartTest Device Farm devices are saved with the pipeline ([Mobile steps](https://docs.smartestqa.ai/en/automate-steps-mobile.html)).
- Mobile pipelines have no start page or environment; the app is the start.

## Desktop projects

A desktop application can be opened only on the machine where it is installed, so desktop pipelines run on agents only: a [Windows machine](https://docs.smartestqa.ai/en/agent-pool-local-setup.html#windows-desktop) for a Windows application, a [Mac](https://docs.smartestqa.ai/en/agent-pool-local-setup.html#macos-desktop) for a macOS application. The platform of each application is set in [Project Settings › Desktop Configuration](https://docs.smartestqa.ai/en/project-settings-desktop.html#general). The Schedule tab says: “Desktop tests run only on an agent (Windows or macOS) where the application and Appium are installed. Select at least one online agent.” The message names Windows, but an online macOS agent with the application and Appium is ticked and used the same way. A desktop pipeline set to the server is moved to **Run on Your Agent** when you open it; save to keep it.

**Application** chooses which [configured desktop application](https://docs.smartestqa.ai/en/project-settings-desktop.html#applications) the run opens: “Each test case's own application” (cases without one use the project default), or one application for every case.

## Start page and environment (web)

Web pipelines open a **start page URL**, which has one address per environment. Both fields are above the dates on the Schedule tab.

- **Start page**: choose one of the project’s start page URLs. [**Manage URLs**](https://docs.smartestqa.ai/en/quick-start-connect.html#start-page-url) opens the list to add or edit one ([Start page URLs](https://docs.smartestqa.ai/en/quick-start-connect.html#start-page-url)). A choice you have not saved yet is marked: “This URL has not been saved yet. It will be saved when you click Save.”
- **Environment**: DEV, TEST or PRP, PRP being the production-side environment. An environment the start page has no address for is greyed out: “No URL defined for this environment”. Switching to a start page without the current environment picks TEST, then DEV, then PRP.
- Test cases follow the [pipeline’s environment](https://docs.smartestqa.ai/en/concepts.html#environments), so one set of tests serves DEV, TEST and PRP.
- A pipeline that contains only [load tests (JMeter or k6)](https://docs.smartestqa.ai/en/automate-steps-load.html) and [API steps](https://docs.smartestqa.ai/en/automate-steps-api.html) opens no browser page; the start page and environment fields are hidden.
- Choosing PRP in a pipeline with a JMeter load test asks first: “Load test on PRP?”.

> **Warning: PRP is real**
>
> Tests on PRP create orders, send e-mails and change data in production. Schedule against PRP only read-only checks you have agreed with the business.

Video: [Server or agent: where should my pipeline run?](https://docs.smartestqa.ai/media/videos/SCH-04.mp4) (2:30)

The same pipeline on the server, then on an agent inside the VPN, and what the queue message means.

Video transcript: Every pipeline has a Run Environment: the server, or your own agent. Run on Server needs nothing installed. Automatic lets the first free server in the shared pool take the run. A specific server pins the run to one server: for an environment behind a VPN or a special setup. The line below shows the load right now. When every slot is busy, the run waits in a queue instead of failing. Run on Your Agent runs the tests on a machine where you installed an agent: inside your network. Pick the agent from the Test Agent List. For an app that is reachable from outside, the server is the simplest choice.

## If something goes wrong

- [“The following agent(s) are currently offline”](https://docs.smartestqa.ai/en/schedule-troubleshooting.html#fix-agents-offline)
- [“Please select at least 1 host…”](https://docs.smartestqa.ai/en/schedule-troubleshooting.html#fix-host-required)
- [“Selected host is not accessible…”](https://docs.smartestqa.ai/en/schedule-troubleshooting.html#fix-host-not-accessible)
- [My run stays “Queued”](https://docs.smartestqa.ai/en/schedule-troubleshooting.html#fix-queued-long)
- [An environment is greyed out](https://docs.smartestqa.ai/en/schedule-troubleshooting.html#fix-env-greyed)
- [“Desktop tests run only on an agent (Windows or macOS)…”](https://docs.smartestqa.ai/en/schedule-troubleshooting.html#fix-desktop-agent-only)
