- Docs
- Resources
- Data Source
- FAQ, MCP & limits
FAQ, MCP & limits
Answers to common questions about Data Source, how AI assistants work with this module, and its limits.
In short
On this page you can
- Find quick answers about sharing, secrets, environments and databases.
- See what an AI assistant can and cannot do with your data and connections.
- Check the module’s limits and timeouts.
How to use it
- Filter the questions by your role with the chips.
- Open a question; follow its link for the full procedure.
- For AI work, connect an assistant and try the example prompts.
- Keep the limits table in mind when you design data-driven tests.
Questions and answers#
Where do I put the password for a login test?Customers
In an encrypted key, for example adminPassword. The Type step’s value is {{ds:adminPassword}}. See Encrypt a value.
How do I use other data on TEST than on DEV?Customers
Keep the default in loginEmail and add loginEmail_TEST. A TEST run uses the variant; steps keep {{ds:loginEmail}}. Datasets work the same way. See Environment-specific keys.
Can an Admin see an encrypted value?Admins
No. Only the person who created it can show it. An Admin can replace it, and can delete the key. See Who can see an encrypted value.
How are secrets stored on the server?Admins
Encrypted keys, DB passwords, Kafka SASL passwords and API request passwords and tokens are stored with AES-256-GCM. On a self-hosted installation, the server needs the encryption key in SMARTEST_ENCRYPTION_KEY; without it these values are stored unencrypted. Ask info@smartestqa.ai if you are unsure how your installation is set up.
Which databases can tests use?Customers
A run reads the database type from the URL and connects to PostgreSQL (jdbc:postgresql), MySQL (jdbc:mysql) and Oracle (jdbc:oracle). For another database, write to info@smartestqa.ai before you build tests on it.
Our database is only reachable inside our network. Can we still use it?Customers
Yes. Run the tests on an agent or self-hosted runner inside the network: DB and Kafka connections are opened from the machine that runs the test. Test Connection will fail because it runs on the SmartestQA server; check with a Dry Run on the agent instead. See Where connections are opened from.
Which addresses must our firewall allow?Admins
For Test Connection and for runs on the server: the SmartestQA server. For runs on an agent: the agent’s machine. Ask info@smartestqa.ai for the current addresses of the SmartestQA servers.
Can a test change data in the database?Customers
Yes. DB steps and DB-bound keys accept INSERT, UPDATE, DELETE, DDL and procedure calls, and the changes are committed. Use a test database and a user with only the rights the tests need.
My workbook has several sheets. Which one is used?Customers
Only the first sheet. Save each sheet as its own file, or move it to the front, and upload one dataset per sheet.
Does connecting an action to a key fill the action’s steps?Customers
No. It tells SmartestQA and the AI which pages need which data. A step still needs {{ds:key}} as its value. See Connected actions.
What happens to tests when a key is deleted?Customers
They keep the reference and lose the value at run time. Search the tests for the key first. Only Admins can delete keys.
Does the AI see our test data?Admins
The AI receives key names, their kind, description and whether they are encrypted, for the pages their connected actions belong to. It never receives key values. Encrypted values never leave the server except to the runner.
Where do I set up the mailbox for OTP and email tests?Customers
Not in Data Source: under Integrations (Email). Use a dedicated test mailbox, never a person’s inbox.
For AI assistants (MCP)#
An assistant connected through the SmartestQA MCP server works with this module through smartest_integrations:
| System | Actions |
|---|---|
jdbc | list the DB connections (credentials masked), usage, query (read), execute (changes data, asks you first), test a saved connection |
kafka | list the Kafka connections (credentials masked). Test them in the screen. |
excel | list: datasets with their columns and row counts |
mail | The test mailbox from Integrations: messages, wait, otp, link |
Connections and credentials are created only in the SmartestQA screen. When a scenario the assistant writes needs data, it creates the keys; a secret is created encrypted and empty, and you fill it in. Connect an assistant from Device FarmTest AgentsConnect to Claude; more in Discover › MCP.
List the DB connections of project "Web Shop" and which test cases use each one.
Check that the orders table on "Orders DB (TEST)" has a row with status NEW. Read only.
Which keys of project "Web Shop" have no value? Suggest what each should contain, but do not write any password.Limits#
| Item | Limit |
|---|---|
| Key name | Unique in the project, no spaces |
| Value sources per key | 1 (typed, dataset cell or DB query) |
| Environments for variants | DEV, TEST, PRP (suffix _DEV, _TEST, _PRP) |
| Dataset and connection names | Unique in the project, case-sensitive |
| Dataset files | XLSX, XLS, CSV; first sheet only |
| Dataset editor | 50 rows per page |
| Kafka Test Connection | 5 seconds |
| Driver message after a failed DB test | 300 characters |
| DB step and DB-bound key query | 30 seconds |
| Kafka Consume wait | 10 seconds default, 300 maximum |
| Masking in logs | Values of 3 characters or more |
| Sharing between projects | Not available |
Didn’t find your answer?Write to support with your project name and what you see on screen.
info@smartestqa.ai