---
title: "FAQ, MCP & limits"
section: "InSight"
description: "Answers to common questions about SmartestQA InSight (roles, dry runs, retries, load tests, fixed assumptions), smartest_status and MCP prompts, and InSight’s limits."
url: https://docs.smartestqa.ai/en/insight-faq.html
audience: [customer, admin]
updated: 2026-11-08
keywords: "insight faq roles same numbers dry runs retries load tests time saved assumption target 80 maturity weights saved report share mcp smartest_status copy mcp prompt limits"
---
# InSight: FAQ, MCP & limits

Answers to common questions about InSight, how AI assistants work with these numbers, and the limits of every list.

## In short

**On this page you can**

- Find out what InSight counts and leaves out.
- Learn which assumptions are fixed: 30 s per step, the 80% target, the maturity weights.
- Use the copied MCP prompts and the smartest_status tool with an assistant.
- Check list sizes and time windows before you trust an empty card.
- Give a five-minute InSight demo.

**How to use it**

1. Filter the questions by your role with the buttons above the list.
2. Open a question; follow its link for the formula or the screen.
3. For assistants, connect one and paste a copied prompt.
4. Check the limits table when a list looks shorter than expected.

## Questions and answers

### Q: Do Admins and Users see different numbers?

No. Anyone with access to the project sees the same InSight, and can save and delete Test Health reports. [Access to a project](https://docs.smartestqa.ai/en/company-settings-users.html#project-access) is granted per user; see [roles](https://docs.smartestqa.ai/en/company-settings-roles.html).

_Audience: admin_

### Q: Are dry runs counted?

No. [Dry runs](https://docs.smartestqa.ai/en/automate-dry-run.html) leave no report, so InSight never sees them. Pipeline runs, test cases started on their own, [manual pipeline runs](https://docs.smartestqa.ai/en/report-summary.html#manual-runs) and [load tests](https://docs.smartestqa.ai/en/report-load-tests.html) are counted. See [the report record and the live log](https://docs.smartestqa.ai/en/report.html#testlog-vs-live-log).

_Audience: customer_

### Q: Do automatic retries change the success rate?

Yes. Each attempt is a scenario run, so a test case that failed and then passed on a [retry](https://docs.smartestqa.ai/en/project-settings-test-management.html#retry-math) adds one failed and one passed run, and counts toward its flaky score. The pipeline run strip, however, judges each test case by its latest attempt. See [Strip marks](https://docs.smartestqa.ai/en/insight-numbers.html#strip).

_Audience: customer_

### Q: How do load tests count?

In Execution they are runs like any other. In Test Health a [JMeter or k6 step](https://docs.smartestqa.ai/en/automate-steps-load.html) counts as a check, so a load test can prove a sub-requirement, but load tests are left out of the scenario funnel.

_Audience: customer_

### Q: Why does “Agents online” include agents from other projects?

[Agents](https://docs.smartestqa.ai/en/agent-pool-agents.html) belong to the company, not to a project, and any project of the company can run on them. The count is the company’s.

_Audience: admin, customer_

### Q: Can we change the 30 seconds per step, the 80% target or the maturity weights?

No, they are fixed: 30 s of manual work per step for [Time saved](https://docs.smartestqa.ai/en/insight-numbers.html#time-saved), 80% as the pillar target, and weights of 35 / 25 / 25 / 15 for [maturity](https://docs.smartestqa.ai/en/insight-numbers.html#maturity). Quote them with the number when you report it.

_Audience: customer, admin_

### Q: How do I share InSight with someone outside SmartestQA?

[Download Execution](https://docs.smartestqa.ai/en/insight-execution.html#download) as Excel or PDF, and print Test Health (live or a [saved report](https://docs.smartestqa.ai/en/insight-test-health.html#saved-reports)) as PDF. Saved reports themselves are only visible inside the project.

_Audience: customer_

### Q: Can I see Test Health for one module only?

On screen, use [Modules × coverage](https://docs.smartestqa.ai/en/insight-test-health.html#modules). An AI assistant can ask for one module’s status through [MCP](https://docs.smartestqa.ai/en/insight-faq.html#mcp).

_Audience: customer_

### Q: How far back can I look?

Execution takes any range of up to 365 days. [Progress](https://docs.smartestqa.ai/en/insight-test-health.html#progress) can go back to the project’s first record; its past points are [rebuilt and approximate](https://docs.smartestqa.ai/en/insight-numbers.html#progress). For an exact picture of a past day, [save a Test Health report](https://docs.smartestqa.ai/en/insight-test-health.html#saved-reports) on that day.

_Audience: customer_

### Q: Where are User Statistics and the weekly metrics chart?

In the classic layout at `/dashboard/default?classic=1`. Its numbers are counted differently; see [Classic view](https://docs.smartestqa.ai/en/insight-execution.html#classic-view) and [its numbers](https://docs.smartestqa.ai/en/insight-numbers.html#classic-view).

_Audience: customer, admin_

## For AI assistants (MCP)

InSight is built to hand work to an assistant connected through the [SmartestQA MCP server](https://docs.smartestqa.ai/en/mcp.html).

- **Copied prompts.** Every [**Copy MCP prompt**](https://docs.smartestqa.ai/en/insight-execution.html#failure-clusters) button copies a ready task. Test Health prompts start with a line such as `SmartestQA project 42 · PROVE · sub:318`, which the assistant reads as a command for that project, [key](https://docs.smartestqa.ai/en/mcp-tools.html#work-keys) and record, then works from there.
- **[`smartest_status`](https://docs.smartestqa.ai/en/mcp-tools.html#tools-overview)** returns the Test Health numbers for the project or one module: coverage, the funnel, the sub-requirements automation cannot prove, and the open work as keys in priority order.
- **`smartest_runs`** reads runs and logs for the Execution questions; see [Report › MCP](https://docs.smartestqa.ai/en/report-faq.html#mcp).
- With an [API key or MCP sign-in](https://docs.smartestqa.ai/en/mcp-connect.html#api-key), an assistant can read Test Health and Execution, but not Progress history or saved reports; those need a login in the app.

Connect an assistant from **Device Farm** › **Test Agents** › [**Connect to Claude**](https://docs.smartestqa.ai/en/mcp-connect.html#claude-desktop); see [Discover › MCP](https://docs.smartestqa.ai/en/discover-faq.html#mcp).

Example prompts

```text
What is the Test Health of project "Customer Portal"? Start on the first open item and tell me what you changed.

Which failure cluster in the last 7 days hits the most scenarios, and is it a product bug or a test problem?

List the risky sub-requirements in module Orders that no passing scenario proves, and write scenarios for the first three.
```

## Limits

| Item | Limit |
| --- | --- |
| Execution period | 1–365 days, default 7 |
| Pipeline run strip | 14 runs per pipeline, looking back at least 56 days |
| Failure clusters | 6 on the card · 100 in the dialog · signature 160 characters |
| Flaky scenarios | 10 · score from 5 runs · last 10 results shown |
| Slowest scenarios | 8 |
| Results by requirement | 10 |
| Failures by action type / by page | 6 each |
| Open tasks listed | 6 |
| Weekly trend | 8 weeks of 7 days |
| Stuck runs | Running over 2 hours, started in the last 30 days |
| Fix these first | 3 |
| Gaps, “check no result” list, not automatable list | 100 rows each |
| Long scenario | over 60 steps |
| Recent run (funnel, pipeline last run, stale) | 30 days |
| Autonomous agents card | last 7 days |
| Progress points | daily up to 31 days, weekly beyond · default 90 days |
| Saved reports | 100 newest listed · name up to 200 characters |
