1. Docs
  2. Resources
  3. Agent Pool & Device Farm
  4. FAQ, MCP & limits

FAQ, MCP & limits

Answers to common questions about test agents and Device Farm, what AI assistants can do here, and the limits.

5 min read Updated CustomersAdmins

In short

On this page you can

  • Find quick answers about agents, devices, live sessions and the App Library.
  • Filter the questions for customers or admins.
  • See what an AI assistant connected through MCP knows about your agents.
  • Look up every limit and time-out of the module in one table.

How to use it

  1. Pick an audience with the filter buttons above the questions.
  2. Open a question; follow its link for the step-by-step page.
  3. Check the limits table before you plan devices or apps.

Questions and answers#

Do I need to install an agent?Customers

Not for a web app reachable from the internet: tests run on the Smartest Server. You need one for apps inside your network, to watch the browser, and for mobile and desktop apps on your own devices. See Do you need an agent?

Can my team share one agent?Customers

Yes. Create a shared agent with Agent (Create a shared agent); everyone in the company sees it under Virtual Machine List. Localhost agents are personal: you see only your own.

How many tests can one agent run at the same time?Customers

As many as its worker limit, shown as the second number of Workers (active/total). More tests wait in Queued. See Agent performance cards.

What happens if my laptop with the agent goes to sleep?Customers

After 90 seconds without a heartbeat the agent turns Offline, and runs that target it fail with “The following agent(s) are currently offline”. Use a machine that stays on, or the Smartest Server for public web apps. See When is an agent Online?

Which operating system does the agent need?Customers

Windows, macOS or Linux for web and Android. Desktop apps need an agent on the same operating system as the app: Windows apps a Windows agent, macOS apps a Mac agent. iOS devices and simulators need a Mac. See Download Client and Mac for desktop tests.

What network access does an agent need?Admins

The agent connects out to SmartestQA and keeps that connection open; your app must be reachable from the agent’s machine. A proxy or firewall that blocks the connection keeps the agent Offline. Only results (logs, screenshots, video) go back to SmartestQA; see Where do my tests run?

How do I replace an agent’s API key?Admins

There is no “new key” button. For a shared agent, delete it and create a new one, then start the client with the new key and update pipelines that targeted the old agent. Localhost agents cannot be deleted.

Who can create, rename and delete shared agents?Admins

Any user of the company can create shared agents, rename them and delete them. Agree on names in your team and do not delete agents that pipelines use. Deleting disconnects a running client at once.

Can we connect our own phones to the Device Farm?Admins

Yes, with the Device Farm right. An admin creates a node and runs its install command on the computer the phones are attached to. Devices on your own nodes are reserved for your company. See Add a node. Without the right, connect phones to your own agent instead (Local device setup).

Can I keep a farm device for myself?Customers

While you hold it with Take device, nobody else and no run can use it. Admins can mark devices Manual so automatic runs never pick them. Booking devices ahead of time is not offered in the app.

Can I control an iOS device live?Customers

Not yet. You can watch the screen; taps and keys work on Android only. See What you can do in a session.

Do I upload my app again for every new build?Customers

Use Replace app on the existing app. The app keeps its place in pipelines and the new build is installed before the next run. See Upload a new version.

How many apps can the App Library hold?Customers

30 apps per company, each with one stored build.

What changes between the cloud service and an on-premise installation?Admins

On-premise, users also see the Nodes tab (read only), live metrics and device logs, and may install App Library builds on devices; admins get a read-only Licence tab, and concurrency, device-minute and reservation limits do not apply. In the cloud service, users see the devices made available to their company and can drive only devices assigned to it. Full table: Who can do what.

Are farm runs limited?Admins

In the cloud service your licence can limit how many farm runs your company has at the same time, which platforms and device kinds (emulators only or real devices) you may use, and device minutes. Minutes are counted per started minute (Run minutes). For your values, ask info@smartestqa.ai. On-premise these capacity limits do not apply.

For AI assistants (MCP)#

An assistant connected through the SmartestQA MCP server (set up in the MCP tab, using the selected agent’s API key) knows about your agents but does not manage them:

  • smartest_context reports the environment, including “agents n/m online”, and warns when no agent is online and no server runner exists.
  • smartest_run_case runs a scenario with runOn = server or agent. It refuses agent when none of your agents is online (AGENT_OFFLINE), runs desktop scenarios only on an agent, and never switches where a run happens without asking you.
  • There is no MCP tool for nodes, devices, live sessions or the App Library today.
Example prompts
Is any of my agents online in project "Mobile Shop"? If not, tell me what to start.

Run the scenario "Login with valid user" on my agent, not on the server.

Why did the last run fail: was it the app, or the agent being offline?

Limits#

ItemLimit
Agent Offline after90 s without heartbeat (checked every 30 s)
Node Offline after180 s without heartbeat, or 60 s with the connection closed (checked every 20 s)
Agent and node namesUnique within the company
Agent performance history24 h, about one point per minute
Apps in the App Library30 per company, one build each
App file types.apk, .aab, .ipa, simulator .zip
Recent runs loaded200 (cloud users: 100)
Rows per page in Recent runs10 · 25 · 50 · 100
One farm run120 min, then closed as Failed
App install on a device6 min, then “timed out”
Live session lease180 s, renewed while open
Live reconnect attempts3 (after 4 s, 10 s, 20 s)
Desktop testsAgent on Windows (Windows driver) or macOS (Mac2 driver)
iOS devicesAgent or node on macOS; live view without control

Didn’t find your answer?Write to support with your project name and what you see on screen.

info@smartestqa.ai
© 2026 Selenity Technology · SmartestQAsmartestqa.aiThis page as MarkdownChecked against smarttest-fe predev 2a8c79cc, smarttest-be 633c2a03, smartest-mcp-server (smartest_context, smartest_run_case)