Welcome to Vibe Testing
Before you can start testing, you'll need at least one API key (Groq or Gemini)
Get a Groq API Key: https://deeps-organization-5.gitbook.io/vibe-testing/getting-api-keys/getting-your-groq-api-key
Get a Gemini API Key: https://deeps-organization-5.gitbook.io/vibe-testing/getting-api-keys/getting-your-gemini-api-key
Install the Vibe Testing Extension
You can install Vibe Testing directly from the Chrome Web Store:
Install Vibe Testing Extension: https://chromewebstore.google.com/detail/vibe-testing-by-contextqa/elenicfihnajicnmdcilpffbfiflcjbe
Alternatively, you can find it manually:
Once installed, you'll see the Vibe Testing icon in your Chrome toolbar.
Launch the Extension Popup
Click the puzzle icon in your Chrome toolbar and select Vibe Testing.
This opens the extension popup — your command center for starting and managing tests.
Pin the extension to your toolbar for quicker access in the future.
Sign In & Configure API Keys
Sign in with Google to enable a secure and personalised experience.
Next, open the Settings panel and add your API key from either:
Groq: https://deeps-organization-5.gitbook.io/vibe-testing/getting-api-keys/getting-your-groq-api-key
Gemini: https://deeps-organization-5.gitbook.io/vibe-testing/getting-api-keys/getting-your-gemini-api-key
This empowers the extension with AI-powered testing capabilities.
You only need one API key to get started.
Start a New Test
Once your API keys are configured, the Configure & Run button becomes available.
Click it to set up your first automated test and begin exploring Vibe Testing in action.
You can customize test preferences such as scope, timeout, and agent type before running.
Configure AI Agent & Notifications
Set up your test by filling out the configuration form:
Test Title → Give your test a clear name.
Deployment URL → Enter the site you want to test.
AI Agent → Choose between UX Analyst, Accessibility Advocate, QA Specialist etc.
Test Case Timeout → Define how long the test should run.
Email for Notifications → Get your report directly in your inbox.
What to Test → Focus on specific area or provide any information for AI Agent.
Custom Instructions → Add extra details or credentials for the AI agent.
Choosing the right agent and scope helps you get tailored insights for your project.
Observe Real-Time Test Execution
Watch your automated test run live.
Step-by-step execution with logs and screenshots.
Follow the AI’s reasoning with “AI Thinking” insights.
This gives you a transparent view of the AI agent’s actions.
Understand AI Intent
For each step, view the AI’s thought process — its intent and reasoning behind every action.
This helps you understand why specific actions were performed and trust the test results.
Analyse In-Depth Test Reports
Once the test completes, access a detailed report:
Summary → High-level overview.
Bug Summary → Prioritized list of issues.
Detailed Scenarios → Step-by-step execution with expected vs actual outcomes.
Screen Recordings & Screenshots → Review the full test visually.
Metadata & Descriptions → For failed scenarios.
Reports can also be emailed directly to you.
Quickly Identify and Prioritise Bugs
The report highlights a dedicated bug summary section:
Each bug includes a concise description.
Quickly triage and assign issues to your development team.
Focus on the most critical issues first.
Deep-Dive Into Test Scenarios
Explore detailed results for each scenario:
Every AI action with expected vs actual outcomes.
Supporting screenshots, logs, and metadata for granular analysis.
Pinpoint exactly where and why issues occur.
AI Product Manager
After a test, the AI may ask follow-up questions about your project:
Answering helps the AI better understand your application.
Improves accuracy and personalization for future tests.
This ensures smarter, more tailored results over time.
Next Steps
Explore Features: https://deeps-organization-5.gitbook.io/vibe-testing/features-of-vibe-testing
Test other websites via URL, not just Vibe coding platforms.
Share reports with your team for collaboration.