---
title: "InSight"
section: "InSight"
description: "InSight is SmartestQA’s home dashboard. Execution shows how your runs went over a period; Test Health shows how complete and trustworthy your test inventory is."
url: https://docs.smartestqa.ai/en/insight.html
audience: [customer, admin]
updated: 2026-11-08
keywords: "insight dashboard home execution test health success rate runs failed runs flaky time saved coverage maturity pillars funnel kpi period live refresh download excel pdf saved report"
---
# InSight

InSight is the first item in the main menu and the page you land on after login. Its Execution tab tells you how your runs went; its Test Health tab tells you how much of your application your tests really prove.

## In short

**On this page you can**

- See success rate, runs, failed runs, flaky test cases, run time and time saved for a period.
- Find the failures that share one cause, and the slowest and least stable test cases.
- Measure coverage in four pillars and one automation maturity score.
- Get the next three things to fix, each with a ready MCP prompt.
- Download Excel or PDF, and save Test Health snapshots.

**How to use it**

1. Open InSight ; pick the Execution or Test Health tab.
2. On Execution, choose the Period and read the six summary cards.
3. Go down to Failure clusters and Flaky scenarios , and open the worst one.
4. On Test Health, read the pillars, then work through Fix these first .
5. Click Save report before a release to keep the picture.

**At a glance**

- **Where:** Main menu › **InSight**, the first item. It is also the page you see after login. Tabs: **Execution**, [**Test Health**](https://docs.smartestqa.ai/en/insight-test-health.html).
- **Who:** Everyone with access to the project. Admin and User see exactly the same numbers.
- **You need:** Execution: runs in the chosen period. Test Health: requirements from [Analyze](https://docs.smartestqa.ai/en/analyze.html), [test cases](https://docs.smartestqa.ai/en/automate-test-cases.html) and [pipelines](https://docs.smartestqa.ai/en/schedule-create.html).
- **Time:** Numbers are calculated when you open the tab or click **Refresh**, in a few seconds.
- **Produces:** Excel and PDF downloads, saved Test Health reports, ready prompts for AI assistants.
- **Reads from:** [Run reports](https://docs.smartestqa.ai/en/report-list.html), requirements, test cases, pipelines and [schedules](https://docs.smartestqa.ai/en/schedule-timing.html), [actions](https://docs.smartestqa.ai/en/discover-actions.html), [tasks](https://docs.smartestqa.ai/en/tasks.html), [agents](https://docs.smartestqa.ai/en/agent-pool-agents.html) and [AI agent runs](https://docs.smartestqa.ai/en/ai-agents-runs.html).
- **Project types:** The same for WEB, MOBILE and DESKTOP. [Load tests](https://docs.smartestqa.ai/en/report-load-tests.html) count as runs in Execution and are left out of Test Health’s scenario funnel.

## Start from your question

I want to…

- [See this week’s success rate](https://docs.smartestqa.ai/en/insight-execution.html#kpis)
- [Find the flaky test cases](https://docs.smartestqa.ai/en/insight-execution.html#flaky-scenarios)
- [See which failures share one cause](https://docs.smartestqa.ai/en/insight-execution.html#failure-clusters)
- [Know what to fix first in coverage](https://docs.smartestqa.ai/en/insight-test-health.html#fix-these-first)
- [Keep a snapshot before a release](https://docs.smartestqa.ai/en/insight-test-health.html#saved-reports)

Something is wrong

- [“Execution could not be loaded”](https://docs.smartestqa.ai/en/insight-troubleshooting.html#fix-load-error)
- [“No runs in this period”](https://docs.smartestqa.ai/en/insight-troubleshooting.html#fix-no-runs)
- [InSight and Report show different numbers](https://docs.smartestqa.ai/en/insight-troubleshooting.html#fix-numbers-differ)
- [“Nothing to measure yet”](https://docs.smartestqa.ai/en/insight-troubleshooting.html#fix-nothing-to-measure)
- [All InSight problems](https://docs.smartestqa.ai/en/insight-troubleshooting.html)

How does it work?

- [How Time saved is calculated](https://docs.smartestqa.ai/en/insight-numbers.html#time-saved)
- [What the flaky score means](https://docs.smartestqa.ai/en/insight-numbers.html#flaky-score)
- [When a failure cluster is Fixed](https://docs.smartestqa.ai/en/insight-numbers.html#clusters)
- [What “proving” a requirement means](https://docs.smartestqa.ai/en/insight-numbers.html#pillars)
- [How the maturity score is weighted](https://docs.smartestqa.ai/en/insight-numbers.html#maturity)

## Where InSight fits

The main menu is the order of work. InSight sits above it and reads every step: Test Health measures how far Discover, Analyze, Automate and Schedule have got, and Execution measures what Schedule’s runs produced in Report.

1. **Discover** — Actions used by tests
2. **Analyze** — Requirements to prove
3. **Automate** — Scenarios that check results
4. **Schedule** — Pipelines and timers
5. **Report** — Run results
6. **Maintenance** — Repairs to review

Use [Report](https://docs.smartestqa.ai/en/report.html) for one run. Use InSight for the pattern across runs and for the state of the whole project.

## Why use it

- **One answer to “are we green?”** The [success rate](https://docs.smartestqa.ai/en/insight-numbers.html#success-rate), failed runs and the [pipeline run strip](https://docs.smartestqa.ai/en/insight-execution.html#pipeline-run-strip) show it per period and per pipeline.
- **Fix causes, not symptoms.** [Failure clusters](https://docs.smartestqa.ai/en/insight-execution.html#failure-clusters) group failed steps with the same error, so twelve red test cases can turn out to be one broken login.
- **Find the tests nobody trusts.** [Flaky scores](https://docs.smartestqa.ai/en/insight-numbers.html#flaky-score) and the [trust checks](https://docs.smartestqa.ai/en/insight-test-health.html#trust-issues) find test cases that flip, or pass without checking anything.
- **Coverage you can defend.** A requirement only [counts as covered](https://docs.smartestqa.ai/en/insight-numbers.html#pillars) when a scenario that checks a result passed on its last run.
- **Work for you or your AI assistant.** Every recommendation has a [**Copy MCP prompt**](https://docs.smartestqa.ai/en/insight-execution.html#failure-clusters) button with the task already written.

## The building blocks

- **Scenario:** InSight’s word for a [test case](https://docs.smartestqa.ai/en/automate-test-cases.html#create-test-case). [Templates](https://docs.smartestqa.ai/en/automate-add-steps.html#add-template) and test cases tagged `planned` are not counted as real scenarios in Test Health.
- **Run:** One [pipeline run](https://docs.smartestqa.ai/en/schedule-runs.html#run-now), or one test case run started on its own. A pipeline run with ten test cases is one run.
- **Scenario run:** One execution of one test case inside a run. The success rate is counted over these.
- **Sub-requirement:** One behaviour from [Analyze](https://docs.smartestqa.ai/en/analyze-requirements.html#sub-requirements) that needs a test. Test Health counts coverage over sub-requirements.
- **Proving scenario:** A scenario with at least one step that checks a result ([assertion](https://docs.smartestqa.ai/en/automate-steps-assertions.html#assertion-step), [visibility check](https://docs.smartestqa.ai/en/automate-steps-browser.html#visibility-check) with text, [validation-mode AI step](https://docs.smartestqa.ai/en/automate-steps-ai.html#modes), [API extractor](https://docs.smartestqa.ai/en/automate-steps-api.html#extract-values), assert-text step, [load test](https://docs.smartestqa.ai/en/automate-steps-load.html)), directly or in a template it calls.
- **Pillar:** One of [four coverage percentages](https://docs.smartestqa.ai/en/insight-test-health.html#pillars): requirement, scenario, risk and action coverage.
- **Maturity:** A [weighted average](https://docs.smartestqa.ai/en/insight-numbers.html#maturity) of the four pillars, 0–100.
- **Failure cluster:** Failed steps whose error messages are [the same](https://docs.smartestqa.ai/en/insight-numbers.html#clusters) once numbers and quoted values are ignored.
- **Flaky score:** How often a scenario’s result [flips between runs](https://docs.smartestqa.ai/en/insight-numbers.html#flaky-score): 0 stable, 1 flips every time.
- **Period:** The date range of the Execution tab. Each number is [compared with the period](https://docs.smartestqa.ai/en/insight-numbers.html#period) of the same length just before it.

## The screen

![InSight with the Execution tab open.](https://docs.smartestqa.ai/media/shots/INS-SHOT-01.png)

The tab row stays at the top while the content scrolls. Its right side holds the tools of the open tab.

| Tab | Answers | Tools in the tab row |
| --- | --- | --- |
| [Execution](https://docs.smartestqa.ai/en/insight-execution.html) | How did our runs go in this period? What failed, why, what is flaky or slow? | [**Period**](https://docs.smartestqa.ai/en/schedule-timing.html#period) picker, live chip, **Refresh**, **Download** (Excel or PDF) |
| [Test Health](https://docs.smartestqa.ai/en/insight-test-health.html) | How much of the application do our tests prove, and what should we fix first? | Live chip, **Refresh**, [**Save report**](https://docs.smartestqa.ai/en/insight-test-health.html#saved-reports), **Reports**, PDF |

- **Live chip.** **Live · just now** or **Live · {n} min ago**: how old the numbers are. They do not update by themselves; click **Refresh**.
- **Which tab opens.** The one in the address (`?tab=execution` or `?tab=health`), otherwise the last one you used in this browser, otherwise **Execution**. A project with [AI agents](https://docs.smartestqa.ai/en/ai-agents.html) opens on [**Test Health**](https://docs.smartestqa.ai/en/insight-test-health.html) the first time.
- **Auto-heal reviews.** When repairs wait for review, a line says “{n} auto-heal repair(s) on {m} test case(s) wait for review.” with **Review**, which opens **Maintain** › [Auto-heal](https://docs.smartestqa.ai/en/maintenance-auto-heal.html#the-screen). It sits in the [Run environment row](https://docs.smartestqa.ai/en/insight-execution.html#run-environment) on Execution and at the top of [**Fix these first**](https://docs.smartestqa.ai/en/insight-test-health.html#fix-these-first) on Test Health.

Video: [InSight in three minutes](https://docs.smartestqa.ai/media/videos/INS-01.mp4) (3:00)

Execution’s period, cards and clusters, then Test Health’s pillars, Fix these first and a saved report.

Video transcript: InSight opens on Execution: what ran in the selected period, and how it went. The period sets the window for every number on the page. Six cards sum it up: success rate, runs, failed runs, flaky scenarios, average run time and time saved. The pipeline run strip shows the last 14 runs of each pipeline. A row of red is where to look. Failure clusters group failed steps that broke for the same reason. Test Health asks a different question: how much of the product is really proven? Automation maturity is one score built from four pillars, each with an 80% target. Fix these first lists the three actions that raise the score most. The coverage funnel shows where requirements drop out on the way to a passing test. Modules × coverage ranks every module by risk, coverage and last results.

## Before you start

| To see | You need | Where you get it |
| --- | --- | --- |
| Execution numbers | Pipeline runs, or test cases run on their own, in the period. [Dry runs](https://docs.smartestqa.ai/en/automate-dry-run.html) are not counted. | [Schedule](https://docs.smartestqa.ai/en/schedule-runs.html#run-now); [Quick Start, step 6](https://docs.smartestqa.ai/en/quick-start-first-test.html#step-6) |
| Requirement and risk coverage | Main requirements with sub-requirements, [linked scenarios](https://docs.smartestqa.ai/en/analyze-test-cases.html#link-existing), severities | [Analyze](https://docs.smartestqa.ai/en/analyze-requirements.html#create-main) |
| Scenario coverage, pipeline maturity | Scenarios in pipelines that have run; schedules | [Automate](https://docs.smartestqa.ai/en/automate.html) and [Schedule](https://docs.smartestqa.ai/en/schedule-timing.html) |
| Action coverage | Actions used by test steps | [Discover › Actions](https://docs.smartestqa.ai/en/discover-actions.html) |
| Agents online, stuck runs | Agents installed for the company | [Install an agent](https://docs.smartestqa.ai/en/quick-start-connect.html#install-agent) |

## Other ways to see the same picture

| Way | Best when | You get |
| --- | --- | --- |
| InSight | You want the whole project at a glance | Execution and Test Health, live |
| [Report](https://docs.smartestqa.ai/en/report.html) | You need the details of one run | Steps, screenshots, logs, AI verdicts |
| [Discover](https://docs.smartestqa.ai/en/discover.html) › Setup Roadmap | You are still setting the project up | The next setup step, see [Progress meters](https://docs.smartestqa.ai/en/quick-start-progress.html) |
| [Excel / PDF download](https://docs.smartestqa.ai/en/insight-execution.html#download) | A status meeting or an audit | One sheet per Execution section, or a print of the tab |
| AI assistant through [MCP](https://docs.smartestqa.ai/en/mcp.html) | You work from your IDE or chat | The Test Health numbers and the open work as a list. See [MCP](https://docs.smartestqa.ai/en/insight-faq.html#mcp). |

## Best practices

#### Do

- Look at Execution every morning with **Last 7 days**; compare weeks with the deltas.
- Fix the biggest [failure cluster](https://docs.smartestqa.ai/en/insight-execution.html#failure-clusters) first: it is usually one cause.
- Give every scenario at least one [step that checks a result](https://docs.smartestqa.ai/en/automate-steps-assertions.html).
- [Link every scenario](https://docs.smartestqa.ai/en/analyze-test-cases.html#link-existing) to a sub-requirement and every risky sub-requirement to a scenario.
- [Save a Test Health report](https://docs.smartestqa.ai/en/insight-test-health.html#saved-reports) before each release.

#### Don’t

- Read the success rate without the number of runs next to it.
- Count “Passed” as proof: a scenario that checks nothing passes too.
- Leave runs [stuck in Running](https://docs.smartestqa.ai/en/schedule-runs.html#stop); they distort run time and the strip.
- Chase a maturity score by adding scenarios that do not check results.
- Expect InSight to refresh itself; click **Refresh** after a run.

## In this section

- [Execution](https://docs.smartestqa.ai/en/insight-execution.html) — The Execution tab: period, run environment, six summary cards, pipeline run strip, failure clusters, flaky and slow test cases, requirements, open tasks, weekly trend and downloads.
- [Test Health](https://docs.smartestqa.ai/en/insight-test-health.html) — The Test Health tab: four coverage pillars and maturity, Fix these first, funnels, modules, pipeline maturity, trust issues, gaps, traceability, stale tests, progress and saved reports.
- [How the numbers work](https://docs.smartestqa.ai/en/insight-numbers.html) — Formulas and worked examples for every InSight number: success rate, runs, flaky score, run time, time saved, clusters, p95, pillars, maturity, funnels, levels and the classic view.
- [Troubleshooting](https://docs.smartestqa.ai/en/insight-troubleshooting.html) — Every InSight message and surprising number, with why it happens, what to check and how to fix it.
- [FAQ, MCP & limits](https://docs.smartestqa.ai/en/insight-faq.html) — Questions and answers about InSight, how AI assistants use Test Health through MCP, and every list size and time window.
