SmartestQADocs
REPORTING

Report

Review test execution results. Screenshots, video recordings, retry count, execute count details and step-by-step execution information.

Overview

The Report module allows you to view detailed results of all your test executions. You can access step-by-step information, screenshots, video recordings, retry information, and error details for each execution.

PASS

Successful tests

FAIL

Failed tests

SKIP

Skipped tests

RUN

Running tests

Report List

When you enter the Report page, you will see a list of all test executions:

ID Pipeline Name Environment Duration Started Triggered By Result Status
1704 aitest TEST 1m 56s 15/01 15:08 Ilkan Si 1/1 COMPLETED
1666 newjs2 TEST 1m 5s 12/01 11:47 Ilkan Si 0/1 FAILED
1609 geneltest TEST 7s 04/01 14:47 Ilkan Si 1/1 COMPLETED
1606 geneltest TEST 11s 02/01 22:39 Ilkan Si 1/1 COMPLETED
1604 newjs2 TEST 20s 02/01 19:55 Ilkan Si 0/1 FAILED

Click on Row

Click on any execution row to go to the detail page.

Re-run

You can re-run the test with the same settings from the right-click menu.

Execution Detail

When you click on a report, you can see all the details of that execution:

1
7/7
Status Log Total Actual Screenshot
Page loaded successfully: https://demo.smartestqa.online/login 3.80s 2.04s
"user@example.com" was entered into the "Enter email address" field 710ms 330ms
"ilkan123" was entered into the "Enter password" field 610ms 220ms
"Click the login button" was clicked 730ms 10ms
"Logo image is displayed." is visible on the page 3.97s 80ms
"Selenity Technology" was selected from "Selecting a company from the combo box." 2.38s 60ms
"ExampleProjectSmartest" was selected from "Selecting project from the combo box" 3.13s 480ms

Each execution is recorded as a video. You can watch the full test flow step by step from the Video panel on the right side. The video plays automatically and shows every action performed during the test, including page navigations, clicks, and data entries. This makes it easy to visually verify test behavior and quickly identify where issues occur.

User Defined Variable Parameters

4
Run Test Case Step Variable
Run 1 3042 Enter username input : testuser@example.com
Run 1 3042 Enter password input : ********
Run 1 3042 Select organization input1 : Acme Corporation
Run 1 3042 Select project input1 : SampleProject

Video

Test execution video
0:04 / 0:04

Run Settings

You can see the settings used for each execution in the Run Settings section:

Execution #EXC-2025-00847 - Run Settings

Environment Staging
Browser Chrome 120
Screen Size 1920x1080
Headless Mode Disabled
Timeout (step) 30 seconds
Retry Count 3
Video Recording Enabled
Screenshot on Fail Enabled
Environment

Which environment (dev/staging/prod) it ran on

Browser & Size

Browser type and screen resolution

Timeout & Retry

Wait time and retry count

Retry & Execute Count

Retry Count

When a step fails, it is automatically retried up to the configured retry count. The report shows how many attempts were made.

Example:

1 First attempt - FAIL
2 Second attempt - FAIL
3 Third attempt - PASS

Execute Count (iter_)

Execute count parameters for data-driven testing. A different data set is used in each execute count.

Global Parameters:

iter_email = user1@test.com
iter_password = Pass123!
iter_name = Test User 1

Execute Count 1/5 - Values change with each execute count

iter_ Prefix: Global parameters starting with iter_ get the next value from CSV/Excel in each execute count. For example, use iter_email, iter_password to run registration tests with 100 users.

Error Analysis

When you click on a failed step, detailed error information is displayed:

ElementNotFoundError

Step 4: Enter card number

Error Message:

Unable to locate element: #card-number-input
Waited for 10 seconds before timing out.
Selector tried:
  - CSS: #card-number-input
  - XPath: //input[@id='card-number-input']

Possible Causes

Selector Changed

The developer may have changed the element ID.

Loading Delay

Page loaded slowly, increase timeout.

Element Hidden

Exists in DOM but not visible.

Feature Removed

This feature no longer exists, update the test.

Filters & Search

Filter the report list and quickly find what you're looking for:

Status Filter
Pass Fail Skip
Date Range
Today Last 7 days This month
Retry Filter
Retry > 0 Passed on first try
Search