Test Suites & Plans

MCP tool reference for managing and executing test suites and test plans in ContextQA.

circle-info

Who is this for? SDETs, developers, and DevOps engineers integrating ContextQA with AI coding assistants (Claude, Cursor) or CI/CD pipelines.

Test suites group related test cases for batch execution. Test plans bundle multiple suites together for full-regression or scheduled runs. Use these tools to list, execute, and monitor suite- and plan-level executions.


get_test_suites

Retrieves a paginated list of test suites in the workspace; use this to discover suite IDs before executing.

Category: Test Suites & Plans | Authentication required: Yes

Parameters

Name
Required
Type
Description

page

integer

Page number (0-based). Defaults to 0.

size

integer

Results per page. Defaults to 20.

sort

string

Sort field and direction, e.g. "name,asc".

query

string

Free-text filter applied to suite names.

Returns

Paginated JSON object with content array of suite records. Each record includes id, name, description, and testCaseCount.

Example

{
  "page": 0,
  "size": 10,
  "query": "checkout"
}

execute_test_suite, get_test_plans, get_test_cases


execute_test_suite

Triggers execution of all test cases within a suite and returns an execution confirmation with the resulting execution ID.

Category: Test Suites & Plans | Authentication required: Yes

Parameters

Name
Required
Type
Description

test_suite_id

integer

Numeric ID of the test suite to execute.

Returns

JSON confirmation with execution_id and execution start metadata. Use get_execution_status with the returned ID to poll progress.

Example

get_test_suites, get_execution_status, get_test_case_results


get_test_plans

Retrieves a paginated list of test plans; use this to discover plan IDs before triggering a plan-level execution.

Category: Test Suites & Plans | Authentication required: Yes

Parameters

Name
Required
Type
Description

page

integer

Page number (0-based). Defaults to 0.

size

integer

Results per page. Defaults to 20.

sort

string

Sort field and direction, e.g. "createdAt,desc".

query

string

Free-text filter applied to plan names.

Returns

Paginated JSON object with content array of test plan records. Each record includes id, name, suiteCount, and lastRunStatus.

Example

execute_test_plan, get_test_plan_execution_status, get_test_suites


execute_test_plan

Executes a full test plan, optionally using a custom AI agent persona or knowledge base to guide execution behaviour.

Category: Test Suites & Plans | Authentication required: Yes

Parameters

Name
Required
Type
Description

test_plan_id

integer

Numeric ID of the test plan to execute.

persona_id

string

ID of a custom agent persona to use. Obtain from list_custom_agents.

knowledge_id

string

ID of a knowledge base to attach. Obtain from list_knowledge_bases.

Returns

JSON with an execution_id string and a human-readable message confirming the plan was queued.

Example

get_test_plans, get_test_plan_execution_status, rerun_test_plan, list_custom_agents, list_knowledge_bases


get_test_plan_execution_status

Polls the status of a running or completed test plan execution; call repeatedly until SUCCESS or FAILURE is returned.

Category: Test Suites & Plans | Authentication required: Yes

Parameters

Name
Required
Type
Description

execution_id

string

Execution ID returned by execute_test_plan.

Returns

JSON object with status (IN_PROGRESS, SUCCESS, FAILURE), overall pass/fail counts, and per-suite breakdown. Poll every 10–30 seconds until a terminal status is reached.

Example

execute_test_plan, rerun_test_plan, get_execution_status


rerun_test_plan

Re-executes a previously run test plan using the same configuration, useful for re-checking a plan after a fix without reconfiguring execution parameters.

Category: Test Suites & Plans | Authentication required: Yes

Parameters

Name
Required
Type
Description

execution_id

string

Execution ID of the original plan run to rerun.

Returns

JSON with a new execution_id for the rerun and a confirmation message. Use get_test_plan_execution_status to track progress.

Example

execute_test_plan, get_test_plan_execution_status, get_test_plans


Last updated

Was this helpful?