For the complete documentation index, see llms.txt. This page is also available as Markdown.

Creating Test Cases

Create web test cases in minutes using ContextQA's unified creation panel — AI-assisted generation, file import, browser recording, or manual authoring.

Who is this for? QA engineers, testers, and developers who want to create web test cases using any of the four creation methods available in ContextQA.

Overview

ContextQA provides a unified test case creation panel with four methods: AI Assistance, Import File, Record & Play, and Manual creation. Click the + icon from the test cases list, the left sidebar, or the global add button to open the creation panel and select your method.


Opening the creation panel

1

Open https://app.contextqa.com and sign in to your workspace. Select Test Cases from the left sidebar to open the test cases list.

2

Click the + icon

Click the + icon in the test cases list header, the left sidebar Create Case button, or the global add button. A full-height panel slides in from the right side of the screen.

3

Select a creation method

The panel presents a method selection screen with up to four options (availability depends on your plan and feature flags):

Method
Description
Button Label

AI Assistance

Provide a description and let ContextQA generate test cases automatically

Start with AI Assistance

Import File

Upload an Excel file, video, or Figma design to generate test cases

Import File

Record & Play

Record your actions in the browser while ContextQA captures each step

Start Recording

Manual

Create a test case with full control over metadata, fields, and configuration

Manually Create a Test Case

After selecting a method, the panel switches to the corresponding view. Use the back arrow in the top-left corner to return to the method selection screen at any time.

The Import File option requires the Upload Excel feature to be enabled on your plan. The Record & Play option requires a paid plan with the Record Playback feature enabled.


Creation methods in detail

AI-assisted test generation

Describe your test scenario in plain English. ContextQA's AI generates all steps, locators, and assertions automatically.

Fields:

Field
Required
Description

Prerequisites

No

Select existing test cases to run before this test. Available on paid plans.

URL

Yes

The starting URL for the test (must begin with http:// or https://). Hidden when prerequisites are selected or when targeting mobile.

Description

Yes

A plain-English description of the test scenario.

Select Target Platform

Yes

Choose Web Application or Mobile. Mobile is available when mobile execution is enabled on your plan.

Example description:

Log in as admin@test.com with password Test123!, navigate to the
Products page, search for "wireless headphones", and verify that
at least one product appears in the search results.

Advanced settings (optional):

Expand the Advanced Settings section to configure AI behavior:

Setting
Options
Default

Enable AI Smartness

Organization Default, Smart, Fast, Strict

Organization Default

AI Action

Organization Default, Create Steps, Dynamic Steps, Action

Organization Default

Knowledge Base

Select a knowledge base to provide application context

None

Environments

Select a target environment

None

Click Generate & Execute Test Case to create and run the test case. If the Generate From Crawl feature is enabled on your plan, you can click Generate From Crawl to create test cases by crawling the target URL.

The AI agent parses your description into discrete steps, generates locators for each element, handles dynamic content and waits automatically, and captures screenshots and video during execution.

Best for: Complex multi-page flows, form submissions, checkout workflows


Mobile platform selection

When you select Mobile as the target platform (from the AI Assistance or Import File tabs), a mobile device setup screen appears before starting execution.

Concurrency indicators appear in the header showing parallel execution slots and queue status.

Field
Required
Description

Select Platform

Yes

Choose iOS (IPA) or Android (APK)

Select Device

Yes

Pick a device from the available device pool (options load based on selected platform)

App Build

Yes

Select the app build to test. If no builds are found, click Go to Upload Page to upload one first.

Desired Capabilities

No

Review and edit key-value capability pairs. Some fields (like app_url and os_type) are read-only.

Click Start Execution to launch the mobile test. If maximum concurrency is reached, ContextQA queues the test and you can click Skip and continue to close the dialog while the test waits in the queue.

For more details on mobile test setup, see the Mobile Testing section.


Verifying generated test cases

After AI generates test cases (from the AI Assistance or Import File methods), a verification screen displays the results.

Each generated test case shows:

  • Title with an internal ID badge (e.g., TC-1)

  • Description of the test scenario

  • Steps with detailed actions

  • Expected Result for the test case

  • Source badges indicating where the test case was derived from

Actions available:

  • Click Save on an individual test case to save it to your project

  • Click Save All Test Cases to save all generated test cases at once

  • Click Cancel to discard the generated test cases

If any test cases were skipped during generation, a Skipped Test Cases section appears with the reason each case was skipped.


Frequently asked questions

How long does it take to create a test case?

With AI Assistance, describing a 10-step workflow takes under 60 seconds. The AI generates and validates all steps automatically. Browser recording typically takes 2–5 minutes for a complete user journey. Manual step creation varies by complexity but most teams create 20–30 step test cases in under 10 minutes.

Can I import existing test cases from spreadsheets?

Yes. Select Import File in the creation panel, choose Import Test Cases mode, and upload an .xlsx or .xls file. Download the sample format to see the expected column structure. ContextQA maps your spreadsheet columns to test case fields automatically.

What browsers and devices are supported?

ContextQA supports all major browsers for test execution:

  • Chrome (desktop + headless)

  • Firefox

  • Safari (macOS)

  • Edge

  • Mobile Chrome / Safari (via device emulation)

For real-device mobile testing, see the Mobile Testing section.

Are screenshots and videos stored automatically?

Yes. Every test execution automatically captures:

  • Per-step screenshots — A screenshot is taken after each step completes

  • Full session video — Complete recording from start to finish (WebM format)

  • Playwright trace — Detailed trace file with network logs, DOM snapshots, and timing (downloadable ZIP)

ContextQA stores and links all evidence directly in the execution results. No configuration required.

Can I run the same test case across multiple environments?

Yes. ContextQA supports environment-based test execution. You can define multiple environments (Development, Staging, Production) and run any test case against any environment by selecting it at execution time. Environment-specific variables (base URLs, credentials, API keys) are managed separately so your test cases remain portable.

How does self-healing work if my application changes?

ContextQA's AI Configuration (self-healing) continuously monitors element locators. When an element changes — for example, a button moves or an ID changes — the AI automatically finds the updated element using visual context, text content, and semantic analysis. The system flags failed locators for review and heals them with one click. See Self-Healing Tests for configuration details.

What are the AI Smartness modes?

AI Smartness controls how the AI generates test steps:

  • Smart — The AI takes more time to analyze the application and produces thorough, detailed steps

  • Fast — The AI prioritizes speed and generates steps quickly with less analysis

  • Strict — The AI follows your description exactly with minimal interpretation

  • Organization Default — Uses the AI Smartness setting configured by your organization administrator

What is the difference between Auto Publish and Required Approval?

When importing test cases via the Import File method, you can choose a publish mode:

  • Auto Publish saves and publishes generated test cases immediately — they are ready to run right away.

  • Required Approval saves generated test cases in a pending state. A team member must review and approve each test case before it becomes available for execution. This is useful for teams that require peer review of test content.


Best practices

Start with happy-path tests — Create and validate your positive test cases first, then add negative scenarios (invalid inputs, error states) once the base flow is verified.



Ready to create your first test?

Last updated

Was this helpful?