1. Docs
  2. Build tests
  3. Discover
  4. Mobile & desktop

Mobile & desktop

Mobile and desktop apps are captured through the agent: the Appium inspector for Android and iOS, the Desktop Recorder for desktop apps.

2 min read Updated CustomersAdmins

In short

On this page you can

  • Capture Android and iOS screens with the Appium inspector.
  • Configure the device: name, app package and activity, or bundle ID.
  • Capture desktop app controls with the Desktop Recorder.
  • See which locators each recorder saves, with their confidence scores.

How to use it

  1. Start the agent and, for a local device, Appium Server on port 4723.
  2. Click Record Actions (mobile) or Desktop Recorder (desktop).
  3. Fill in the settings; on mobile choose This computer or Device Farm.
  4. Tap the elements on the live screen, or click them in the desktop app.
  5. Name the page and save; on mobile click Save Steps.

You need

The SmartestQA agent running and online on the computer next to the device or app. For Android and iOS on this computer, Appium Server on http://localhost:4723. See Install an agent.

Mobile (Android and iOS)#

  1. Open the inspector

    In a MOBILE project click Record Actions (tooltip “Open Appium Inspector”).

  2. Configure the device

    In Configure Mobile Device the platform is fixed by the project. Fill Device Name, App Package and App Activity (Android) or Bundle ID (iOS), optionally App Path, and pick the source: This computer or Device Farm.

  3. Record the screen

    Switch Record on and tap elements on the live screen; each one is added. Use the All Actions and Steps tabs to check the list.

  4. Save

    Give the page a name and click Save Steps. The window says “n actions will be created”, then “n actions saved successfully.”

Saved locators, best first: a resource-id XPath (score 95), accessibility_id (90), the full XPath (80). The two top scores swap when accessibility ID is the chosen strategy. Each action also keeps an element screenshot and its bounds. Without a page name, the platform name is used.

Desktop#

  1. Open the recorder

    In a DESKTOP project click Desktop Recorder. An online agent on the Windows or macOS computer with the app is required; otherwise you see “No agent is online”. On macOS the app that runs the agent needs the Accessibility permission (System Settings › Privacy & Security › Accessibility); without it the recorder reports “Accessibility permission is missing for the app that runs the SmartTest agent…”.

  2. Configure the app

    Fill Target Application, Platform, the app identifier (AUMID / App ID on Windows, Bundle ID on macOS), and optionally App Path and App Arguments. Page Name defaults to Desktop.

  3. Record and save

    Click elements in the app and save. Locators kept: delphiPath (98), automationId (95), element text (70) and an XPath.

If something goes wrong#

Didn’t find your answer?Write to support with your project name and what you see on screen.

info@smartestqa.ai