Browse QA Skills

Testing patterns for autonomous AI coding agents like Devin and SWE-Agent including task verification, output validation, sandboxed execution, regression testing for agent behavior, and safety guardrails for autonomous code generation.

Optimizing test coverage beyond line coverage including branch coverage, mutation score, path coverage, and identifying meaningful coverage gaps.

Test-Driven Development mastery with red-green-refactor cycle, outside-in TDD, test-first design, and incremental development patterns.

SOAP web service testing including WSDL validation, XML schema testing, WS-Security, and SOAP fault handling verification.

Automated scanning of project dependencies for known vulnerabilities using tools like npm audit, Snyk, and Dependabot patterns.

gRPC service testing including protobuf validation, streaming tests, error handling, deadline testing, and load testing for gRPC endpoints.

Testing LLM-powered features including output quality validation, hallucination detection, token usage monitoring, and prompt regression testing.

Testing concurrent code including race condition detection, deadlock prevention, thread safety verification, and parallel execution correctness.

API simulation and service virtualization with WireMock for HTTP stubbing, request matching, stateful behavior, and fault injection testing.

Testing API rate limiting implementations including throttling behavior, burst handling, rate limit headers, and distributed rate limiting patterns.

Automatically generating API tests from OpenAPI/Swagger specifications including request validation, response schema checking, and edge case generation.

Validating A/B test implementations including traffic splitting accuracy, statistical significance calculation, metric tracking, and experiment cleanup.

Cloud-based cross-browser and cross-device testing with BrowserStack including Automate, App Automate, Percy visual testing, Observability, and integration with Playwright, Selenium, and CI/CD pipelines.

Grade LLM and agent traces with OpenAI Evals - build datasets, configure string/python/model graders, run eval suites, and gate agent behavior changes in CI.

Integration testing with Sentry for error tracking, performance monitoring, and release health verification in production environments.

Testing distributed tracing and observability instrumentation with OpenTelemetry including span verification, metric collection, and log correlation.

Testing PDF generation including layout verification, content accuracy, font embedding, accessibility (PDF/UA), and cross-platform rendering consistency.

Testing Server-Sent Events implementations including event stream validation, reconnection behavior, event ID tracking, and EventSource client testing.

Testing PCI-DSS compliance for payment processing including encryption validation, access control testing, and secure data storage verification.