Creating Test Cases
Create ContextQA test cases with AI assistance, file import, browser recording, or manual authoring, then verify the saved test in the editor.
Quick answer
Create ContextQA test cases with AI assistance, file import, browser recording, or manual authoring, then verify the saved test in the editor. Follow the documented prerequisites and steps, then verify the expected result before using the workflow in a shared or production process.
What this page covers
Overview
ContextQA provides a unified three-step creation dialog with four methods: AI Assistance, Import Files, Record & Play, and Create manually. Use this page when you need to create a test case and verify it in the test case editor.
Recorder versus extension testing: Record & Play uses the ContextQA recorder capability to capture a web flow. Testing a browser extension that belongs to the application under test is a separate environment setup: the extension build must be installed in a compatible managed browser, and its permissions and cross-surface workflow must be validated. See Complex web and authentication workflows.
Opening the creation panel
Navigate to test development
Open https://app.contextqa.com and sign in to your workspace. Select Test Cases from the left sidebar to open the test cases list.
Select a creation method
The panel presents a method selection screen with up to four options (availability depends on your plan and feature flags):
AI Assistance
Provide a description and let ContextQA generate test cases automatically
Start with AI Assistance
Import Files
Upload requirements or test files to generate test cases
Import Files
Record & Play
Record your actions in the browser while ContextQA captures each step
Start Recording
Manual
Define the case and its steps yourself
Create manually
After selecting a method, the dialog shows step 2 with the available starting action. Select Back to return to the preceding step.
Creation methods in detail
AI-assisted test generation
Describe your test scenario in plain English. ContextQA's AI generates all steps, locators, and assertions automatically.
Fields:
Prerequisites
No
Select existing test cases to run before this test. Available on paid plans.
URL
Yes
The starting URL for the test (must begin with http:// or https://). Hidden when prerequisites are selected or when targeting mobile.
Description
Yes
A plain-English description of the test scenario.
Select Target Platform
Yes
Choose Web Application or Mobile. Mobile is available when mobile execution is enabled on your plan.
Example description:
Log in with the fictional documentation account, navigate to the
Products page, search for "wireless headphones", and verify that
at least one product appears in the search results.Advanced settings (optional):
Expand the Advanced Settings section to configure AI behavior:
Enable AI Smartness
Organization Default, Expert, Fast, Strict
Organization Default
AI Action
Organization Default, Create Steps, Dynamic Steps, Action
Organization Default
Knowledge Base
Select a knowledge base to provide application context
None
Environments
Select a target environment
None
Click Generate & Execute Test Case to create and run the test case. If the Generate From Crawl feature is enabled on your plan, you can click Generate From Crawl to create test cases by crawling the target URL.
The AI agent parses your description into discrete steps, generates locators for each element, handles dynamic content and waits automatically, and captures screenshots and video during execution.
Best for: Complex multi-page flows, form submissions, checkout workflows
Import test cases or requirements
Upload files to generate test cases automatically. Three modes are available:
Mode selection:
Import Test Cases
Upload an Excel spreadsheet (.xlsx, .xls) containing test case definitions
Import Requirements
Upload requirements documents (XLSX, CSV, TXT, PDF) or video files (MP4, MOV, WEBM, MPEG, MKV) to generate test cases from specifications
Import from Jira
Browse and select Jira tickets to generate test cases from ticket descriptions and acceptance criteria
Select Target Platform:
Web Application
Always available
Mobile
Always available
API
Available in Import Requirements mode only
Publish mode:
Select how imported test cases are published:
Auto Publish
Generated test cases are saved and published immediately
Required Approval
Generated test cases are saved in a pending state and require manual review and approval before publishing
Test case types:
Select which types of test cases the AI generates. Toggle individual types on or off, or click All Types to include every type:
Positive
Validates expected behavior with valid inputs
Functional
Verifies feature functionality against requirements
Negative
Tests error handling with invalid inputs
Edge
Covers boundary and unusual scenarios
Field Validation
Checks input field constraints and formatting
End to End
Validates complete user workflows
Boundary Value
Tests at the limits of acceptable input ranges
Optional configuration:
Create Test Suite
Automatically create a test suite containing the imported test cases. Enter a suite name.
Create Test Plan
Create a test plan for the imported cases. Enter a plan name. Automatically enables test suite creation.
Execute Test Plan
Run the test plan immediately after import. Available when Create Test Plan is enabled.
Context fields (optional):
Before uploading files, you can provide additional context to improve AI test generation:
Name
A descriptive name for the requirement (e.g., "Login flow requirements")
Additional information
Goals, notes, or context about the requirements that help the AI generate more accurate test cases
File upload — Import Test Cases mode:
Upload .xlsx or .xls files. A Download Sample Format link is available to get the expected spreadsheet structure.
File upload — Import Requirements mode:
You can upload up to 10 files per upload. Accepted file types depend on the target platform:
Accepted file types depend on the target platform:
Web / Mobile: documents (
.xlsx,.xls,.docx,.csv,.txt,.pdf), image files (.png,.jpg,.jpeg,.webp,.gif), or video files (.mp4,.mov,.webm,.mpeg,.mkv)API:
.jsonfiles
When uploading requirements, the import follows a guided multi-step flow:
Inputs — Upload your files, add context, and configure platform, publish mode, and optional settings
Analysis — ContextQA analyzes the uploaded documents and extracts testable requirements
Clarifications — The AI may ask follow-up questions about ambiguous requirements. Answer them to improve test case accuracy.
Generate — Test cases are generated from the analyzed requirements
Review — Review the generated test cases before saving
Import from Jira mode:
When you select Import from Jira, the flow adds a Jira ticket picker step:
Inputs — Configure platform, publish mode, context fields, and optional settings, then click Continue to Jira Tickets
Pick Jira Tickets — Search for tickets by key (e.g.,
PROJ-123) or text, browse results with infinite scroll, and select one or more tickets. Enable Include linked tickets to automatically pull in sub-tasks and epic children (up to 50 linked tickets). Click Continue to Review when your selection is complete.Analysis — ContextQA reads the selected ticket descriptions, acceptance criteria, and linked content to extract testable requirements
Clarifications — Answer any AI follow-up questions
Generate — Test cases are generated from the Jira ticket content
Review — Review the generated test cases before saving
Figma integration:
When the Figma feature is enabled, select Figma as the source instead of file upload. Enter a Figma file URL (matching the pattern https://www.figma.com/file/..., https://www.figma.com/proto/..., or https://www.figma.com/design/...).
Click Create Test Cases to start the generation process.
Best for: Migrating existing test libraries, generating tests from requirements documents, importing from Jira tickets, creating tests from design files
Browser recording
Record your actions in the browser while ContextQA captures each interaction as a test step.
This method requires the ContextQA Recorder Chrome extension. If the extension is not detected, the panel displays installation instructions with a link to the Chrome Web Store.
When the extension is installed:
Prerequisites
No
Select existing test cases to run before this test
URL
Yes
The starting URL for recording. Shows your open browser tabs as suggestions.
Click Create Test Case to start recording. ContextQA opens the target URL with the recorder active. Navigate and interact with your application normally — the recorder captures each click, text entry, and navigation as a step. Click Stop Recording to finalize.
When the extension is not installed:
Click the link to install the ContextQA Recorder from the Chrome Web Store
Enable the extension in incognito mode
Close and reopen the creation panel
Best for: UI exploration, click-heavy workflows, onboarding flows
Manual test case creation
Create a case directly in the dialog, then define its steps in the full builder.
Select Create manually at step 1.
Select Open step builder at step 2.
At step 3, enter the required Name.
Optionally set Priority, Type, Status, Prerequisites, Labels, advanced options, and Description.
Select Create Test Case.
Confirm the editor opens and the Test Case created successfully notification appears.
Form fields:
Name
Yes
Descriptive test case name
Priority
No
Select from available priority levels
Type
No
Select the test case type
Status
No
Draft, Ready, In Review, Approved, Obsolete, or Rework. Default: Ready
Prerequisites
No
Select existing test cases to run before this test
Labels
No
Add labels for organization and filtering
Testcase Timeout
No
Maximum execution time in minutes (1–40). Default: 20
Description
No
Rich text description of the test case
Test data options:
Test Data Profile
Select a data profile for parameterized testing
Data Driven
Enable to run the test across multiple data sets from the selected profile
Data Set
When not data-driven, select a specific data set from the profile
Iteration From / To
When data-driven, define the range of data set iterations
Additional toggles:
Mobile Testing
Switch the test case type from web to mobile
Extension Used
Mark whether the ContextQA Chrome extension is used
Avoid auto wait for steps
Disable automatic wait insertion between steps
Select Show Advanced Options to review additional execution settings when needed. Select Create Test Case to save the case and open its details page.
Best for: Precise control over test metadata, data-driven testing configuration, complex assertions
Verify a manually created test case
After creation, confirm that the details page shows the new name and the Test Steps, Relationships, and Version History tabs. The side panel should show Test Case, Variables, Used in Test, and Run History. Return to Test Cases and search by the new title or assigned TC- identifier to verify list placement.
Verify the test from the list
Return to Test Cases.
Enter the test's
TC-identifier or a distinctive part of its title in Search by ID or Title.Confirm that the row shows the expected Type, Priority, Result, Status, and Labels.
Switch between List and Modular view when you need a different way to browse the collection.
Use Filter to narrow a large test library instead of relying on naming alone.
A successful creation is not complete verification. Run the saved test once and review its steps, console, network activity, screenshot, video, and trace before promoting it into a shared suite.
Run a documentation-safe verification
When the test exists only to produce product documentation evidence, keep it separate from valuable regression tests:
Prefix the title with
DOC-and include the feature and expected outcome—for example,DOC — Test Cases — Open list and verify controls.Use fictional data and a non-production environment.
Reuse a stable login prerequisite instead of copying credentials into steps.
Add a viewport-safe verification that names only controls visible together on the page.
Run the test and wait for a final passed or failed status.
Open View Run Results and review all evidence before using it in documentation.
Record the test ID and run ID in the documentation task.
Delete the disposable test from the active list after the evidence is approved. Do not edit or delete the source regression test when you created the documentation test by duplication.
For every capability on the live execution and completed result screens, see Execution and test results.
Mobile platform selection
When you select Mobile as the target platform (from the AI Assistance or Import Files tabs), a mobile device setup screen appears before starting execution.
Concurrency indicators appear in the header showing parallel execution slots and queue status.
Select Platform
Yes
Choose iOS (IPA) or Android (APK)
Select Device
Yes
Pick a device from the available device pool (options load based on selected platform)
App Build
Yes
Select the app build to test. If no builds are found, click Go to Upload Page to upload one first.
Desired Capabilities
No
Review and edit key-value capability pairs. Some fields (like app_url and os_type) are read-only.
Click Start Execution to launch the mobile test. If maximum concurrency is reached, ContextQA queues the test and you can click Skip and continue to close the dialog while the test waits in the queue.
For more details on mobile test setup, see the Mobile Testing section.
Verifying generated test cases
After AI generates test cases (from the AI Assistance or Import Files methods), a verification screen displays the results.
Each generated test case shows:
Title with an internal ID badge (e.g.,
TC-1)Description of the test scenario
Steps with detailed actions
Expected Result for the test case
Source badges indicating where the test case was derived from
Actions available:
Click Save on an individual test case to save it to your project
Click Save All Test Cases to save all generated test cases at once
Click Cancel to discard the generated test cases
If any test cases were skipped during generation, a Skipped Test Cases section appears with the reason each case was skipped.
Frequently asked questions
Best practices
Name tests descriptively — Use the format [Page] - [Action] - [Expected Result] (e.g., Login Page - Valid Credentials - Dashboard Loads). This makes test results immediately understandable.
Avoid hard-coded waits — Don't use Wait 5 seconds steps. Instead, use Wait for element or Wait for network idle actions. ContextQA's AI handles timing automatically.
Related documentation
Requirements Management — Upload requirements, review AI analysis, and track coverage gaps
Debugging Test Cases — Step through execution with breakpoints and live variables
Test Steps Editor — Detailed guide to all available step actions
Version History — Track, compare, and restore previous test case versions
Managing Test Suites — Organize test cases into suites for batch execution
Self-Healing Tests — AI-powered test maintenance
Test Data Management — Variables, CSV imports, and data-driven testing
AI Test Generation — All 10 AI test generation methods
Mobile Testing — Mobile test creation and execution
Execution & Reporting — Run tests, view results, set up CI/CD
Execution and Test Results — Monitor a live run and inspect steps, logs, screenshots, video, and trace evidence
Last updated
Was this helpful?
