Testing
166 items from thejambo/awesome-testing ★2,389
-
Kiwi TCMS github.com
Open-source test case management.
-
Hercules github.com
Open-source end-to-end testing agent.
-
tapflow github.com
Self-hosted mobile QA tool that streams iOS simulators and Android emulators to the browser for team-wide testing without local setup.
-
dbmask github.com
Open-source tool that scans SQL databases for sensitive columns, masks them with deterministic fakes, and validates the masked copy row by row against the original.
-
assay github.com
Deterministic command-line QA tool that serves a local web page, drives every control it finds in Chromium through Playwright. No tests to write and no LLM, with a Python API, an HTML report, and a plugin for AI coding agent. MIT, Python.
-
flutter-skill github.com
AI-powered E2E testing via MCP for Flutter, React Native, iOS, Android, Electron, Tauri, KMP, and .NET MAUI. Zero test code.
-
Sherlo github.com
Visual testing platform for React Native Storybook. Captures screenshots on iOS and Android simulators in the cloud and detects visual changes automatically.
-
OrcaPromptVault github.com
Dated archive of the system prompts and tool-call schemas shipped AI agents send, so tests can be written against a product's real declared tool surface rather than a guess at it.
-
OrcaReplay github.com
Records a coding-agent session below the harness, keeping the verbatim request and response bytes, then replays the same run offline with the network off or forks it from a checkpoint onto other models with a verify command deciding the verdict.
-
recheck-web github.com
Change comparison tool with Golden Masters and "unbreakable Selenium" tests.
-
test-each github.com
Data-driven testing framework.
-
DATAMIMIC CE github.com
Open-source, deterministic engine for model-driven synthetic test data and PII pseudonymization. Pin a seed and get byte-identical output with a provenance hash on every run. Python, MIT.
-
Locust Kubernetes Operator github.com
Run distributed Locust load tests on Kubernetes with a LocustTest CRD.
-
optics-framework github.com
Self-healing test automation for mobile, web and Smart TV. Keyword-driven CSV/YAML tests run on Appium, Selenium and Playwright; when a locator breaks it falls back across XPath, text, OCR and image strategies, with optional AI-powered self-healing.
-
Software Testing Interview Tool github.com
A very buggy To Do List to facilitate face to face interviews.
-
GoodLooks github.com
AI-powered visual validation for Playwright tests.
-
voicetest github.com
Open-source test harness for voice AI agents supporting Retell, VAPI, LiveKit, and Bland with autonomous simulations and LLM-based evaluation.
-
OpenTester github.com
MCP-First Testing Framework: AI Agents Can Now Test Like Humans
-
Swagger Coverage Tool github.com
The Swagger Coverage Tool is designed to measure API test coverage based on Swagger documentation. It provides automated tracking and reporting of test coverage for APIs, helping ensure that your endpoints and services are well-tested.
-
Load Testing Hub Panel github.com
Ultimate web UI for visualizing load test results
-
ai-natural-language-tests github.com
Generates Cypress and Playwright E2E tests from natural language requirements using LangGraph, ChromaDB, and multi-provider LLM support.
-
SpecTest github.com
Truly declarative API testing framework in Js, or plain JSON.
-
postman2pytest github.com
Convert a Postman Collection v2.1 JSON file into a ready-to-run pytest test suite.
-
Evaliphy github.com
Test your AI system end-to-end with Evaliphy. It uses a Playwright-style testing approach and generates HTML reports.
-
Webhook Debugger github.com
Open-source, self-hosted webhook inspector with signature verification support.
-
Robot Framework Solidity Testing Toolkit github.com
Robot Framework integration for Solidity testing.
-
Tests Coverage Tool github.com
Ultimate tool to measure gRPC service coverage from tests.
-
UI Coverage Tool github.com
UI Coverage Tool is an innovative, no-overhead solution for tracking and visualizing UI test coverage — directly on your actual application, not static snapshots.
-
Tenro github.com
Open-source testing framework for AI agents. Simulate LLM and tool calls to test edge cases, failure paths, and agent logic without live API calls.
-
FrontRow github.com
Open source React Native mobile app built as a hands on training surface for QA automation. Cross platform testIDs work across Maestro, Appium, Espresso and XCUITest, and a deep QA Debug Menu lets trainees force the failure modes that actually bite in production (4xx, 5xx…
-
Waterfall AI Test github.com
Open-source visual workbench for Playwright Test Agents that turns requirements into editable plans and verified Playwright tests with human review, repair workflows, version history, and execution evidence.
-
qmax-mcp github.com
MCP server and CLI that gives coding agents independent QA evidence before they declare a web change done: scans a URL for console errors, broken links, accessibility issues, Core Web Vitals, SEO, security headers, and cookies/trackers, then generates and runs a deterministic…
-
skipper github.com
Real-time test execution control via Google Spreadsheet, enabling instant toggle without code changes.
-
aiexpect github.com
Python assertions for non-deterministic AI text that drop into pytest. Semantic and rule checks work offline; optional LLM judge with your own model; produces a Trust Score and a single-file HTML report.
-
flight-recorder github.com
Record every nondeterministic input your code reads (LLM answers, HTTP, database, clock, randomness) as one JSONL tape per request, then replay the tape against the real code offline, bit for bit, with the first divergence named. Open format with Python, Node, .NET, Go, Java…
-
ai-wright github.com
Open-source library that adds AI action, assertion, and data extraction steps to Playwright tests, using annotated screenshots and your own OpenAI, Gemini, or Claude API key.
-
Drengr Runner github.com
Drive an iOS simulator over HTTP from any language. A 479-line Swift XCTest target replacing WebDriverAgent on simulators. Apache-2.0.
-
crilio github.com
An open-source Python CLI that uses LLM-as-a-Judge to automate semantic regression testing for LLM prompts in CI/CD, blocking GitHub PRs that cause hallucinations or break formatting rules. Supports OpenAI, Anthropic, and local Ollama models.
-
postal-code-formats github.com
Postal code formats, validation regexes and 9,000 real sample codes for 31 countries, with every regex tested against the samples in CI.
-
VertaaUX CLI github.com
UX, accessibility, and conversion audits from the terminal and CI, with score-based quality gates and PR regression detection.
-
JSON Validation Test Cases github.com
Reusable valid, invalid, and edge-case JSON fixtures for testing parsers, validators, APIs, editors, and error handling.
-
AgentSkeptic github.com
Verifies AI/agent workflows by checking database state after execution, comparing expected vs observed outcomes with read-only SQL.
