gvasile29/qai-consultant

An open-source AI agent that acts as a senior QA Architect — automatically generating a **Test Strategy**, **Risk Register**, **Effort Estimation Report**, and **Test Plan** from a simple project description, plus deterministic **QA Document Quality Review**, **Test Results Analysis**, and **QA Maturity Assessment** for evaluating what already exists. Also available as a local **MCP server** so Claude Code, Claude Desktop, and other MCP clients can ground their own QA work in the same standards and numbers.
> 🌐 **Live demo:** quality-ai-consultant.streamlit.app
> 🔌 **MCP server:** uvx qai-consultant-mcp — no API keys, no Pinecone. See MCP Server below or the package on PyPI.
> 🤖 Built with Claude Code by Anthropic.
---
Screenshots
Web UI (Streamlit)
**Landing page**
**MCP panel in the sidebar**
**Project Discovery dialogue** (Web Application template applied)
**Executive Readout + generation status**
**Risk Register** (Risk Ledger table)
**Effort Estimation**
**Test Strategy**
**Test Plan**
**QA Document Quality Review**
**QA Maturity Assessment**
CLI
---
Quick Start
Option A — Use the live app (no setup)
👉 quality-ai-consultant.streamlit.app
Option B — Run locally
> 📖 Full installation guide: INSTALL.md
---
The Problem
Creating a Test Strategy from scratch is time-consuming and requires deep QA expertise. Most teams either skip it, do it superficially, or spend days researching methodologies.
QAI Consultant eliminates this bottleneck by combining established QA methodologies, industry standards (ISTQB, OWASP, ISO 26262, A-SPICE), and expert knowledge into an AI agent that thinks like a seasoned QA Architect.
---
Who Is This For?
- **QA Engineers** who need structured guidance on test strategy
- **Engineering Managers** who need effort estimations and resource planning
- **Development teams** without a dedicated QA Architect
- **QA Consultants** who want to accelerate their delivery
---
What QAI Consultant Generates
From a single 11-question dialogue, QAI Consultant automatically generates **four documents**:
| Document | What it contains |
|---|---|
| ⚠️ **Risk Register** | Risk matrix, likelihood/impact analysis, mitigations per risk |
| 📊 **Effort Estimation Report** | PERT-based breakdown, team capacity analysis, confidence score |
| 📋 **Test Strategy** | ISTQB-aligned strategy tailored to your stack, methodology, and compliance |
| 📝 **Test Plan** | IEEE 829-aligned plan with entry/exit criteria, schedule, and AI tool oversight |
Above the four tabs, an **Executive Readout** summarizes overall risk, the QA effort range, team capacity, confidence, and the top 3 risks — computed deterministically from the Risk Register and Effort Estimation, with no extra LLM call.
All outputs are saved as Markdown files and available for PDF download.
**Evaluating what already exists** (deterministic, no LLM needed for the scores):
| Mode | What it does |
|---|---|
| 📝 **QA Document Quality Review** | Scores an existing Test Plan / Strategy / test case list 0–100 across six ISTQB/IEEE 829 dimensions, with findings and knowledge-base citations |
| 🧪 **Test Results Analysis** | Flaky, ever-failing, never-run and slowest tests plus failure clustering from JUnit XML/CSV — optionally used to ground the Risk Register in real execution data |
| 📈 **QA Maturity Assessment** | Indicative TMMi level (1–3) across 10 process areas from a free-text description, plus an EU AI Act Articles 9–15 readiness check for AI/ML systems |
---
Knowledge Base
QAI Consultant's recommendations are grounded in real QA standards and methodologies:
- 📘 **ISTQB** — 14 certification syllabuses (CTFL, CTAL-TA, CTAL-TM, CTAL-TAE, CT-AI, and more)
- 🔒 **OWASP** — WSTG v4.2, MASTG, Top 10 2021
- 🚗 **ISO 26262** — Automotive functional safety (ASIL levels, HARA, V&V)
- 🏭 **A-SPICE** — Automotive SPICE process reference model (SWE.4, SWE.5, SWE.6)