Blog

Database Seeding per Test vs per Suite

Compare database seeding per test vs per suite, including transaction rollback, fixture ownership, parallel workers, and hybrid patterns for reliable fast suites.

AI Testing

DeepEval Tool Correctness Metric Example

Use DeepEval Tool Correctness Metric with real agent traces, expected calls, strict arguments, ordering, and regression cases that expose wrong tools.

Deterministic Faker Seeds in Parallel Tests

Design deterministic Faker seeds for parallel tests, reproduce failures by test identity, avoid worker collisions, and preserve realistic data variation.

Disable Animations and Carets in Playwright Screenshots

Disable animations and blinking carets in Playwright screenshots, stabilize visual baselines, and keep meaningful UI regressions visible in CI.

Ensure pytest Yield-Fixture Cleanup After Failure

Make pytest yield-fixture cleanup reliable when tests or setup fail, using safe fixture boundaries, finalizers, context managers, and verified teardown.

Exclude Browser and OS Combinations from a GitHub Actions Matrix

Exclude browser and OS combinations from a GitHub Actions matrix while preserving targeted Playwright coverage, readable jobs, and intentional failure policy.

Exclude Generated Files from Jest Coverage

Exclude generated files from Jest coverage without hiding authored code, using precise collection rules, Istanbul directives, and auditable thresholds.

Factory Boy post_generation for Many-to-Many Test Data

Use Factory Boy post_generation for Django many-to-many test data with explicit related objects, safe defaults, through models, batching, and isolated assertions.

Fail CI Only on New Coverage Regressions

Enforce changed-code coverage in CI while leaving legacy gaps visible, using diff-aware line checks, stable baselines, and actionable pull request failures.

Handle Missing Requests During Playwright HAR Replay

Configure Playwright HAR replay notFound fallback safely, diagnose unmatched requests, prevent accidental live traffic, and keep recordings maintainable.

How to Shard Playwright Tests by File Instead of Project

Shard Playwright tests by file with predictable CI distribution, avoid project duplication, inspect shard membership, and balance uneven spec runtimes.

How to Test a Debounced Search Input in Playwright

Learn deterministic Playwright debounce testing with the Clock API, request inspection, boundary checks, and no brittle fixed sleeps in your search tests.

How to Test WebSocket Messages in Cypress

Test WebSocket messages in Cypress by controlling server events, observing browser state, and asserting reconnection, ordering, and malformed-frame behavior reliably.

How to Test WebSocket Reconnection in Playwright

Test WebSocket reconnection in Playwright with deterministic server closes, real offline transitions, retry assertions, and duplicate-subscription checks.

How to Wait for a Dynamic URL Response in Playwright

Learn how to wait for a dynamic URL response in Playwright by matching paths, query parameters, methods, status codes, and concurrent requests safely.

HTML5 Drag and Drop with DataTransfer in Playwright

Implement HTML5 drag and drop with DataTransfer in Playwright, including custom MIME payloads, file drops, event diagnostics, and reliable outcome checks.

In-Source Testing with import.meta.vitest

Use import.meta.vitest for focused in-source testing with correct Vitest configuration, TypeScript typing, production dead-code removal, and maintainable boundaries.

Intercept GraphQL Requests by Operation Name in Cypress

Intercept GraphQL requests by operation name in Cypress to stub one query or mutation, preserve unrelated traffic, and make network assertions precise.

Jest “Cannot Log After Tests Are Done” Fix

Fix Jest Cannot Log After Tests Are Done by tracing unawaited callbacks, owning timers and subscriptions, and proving teardown completes before exit.

Jest “Did Not Exit One Second After the Test Run” Fix

Fix Jest did not exit one second after the test run by tracing open servers, sockets, timers, workers, and database pools to their missing cleanup.

Jest “Invalid Hook Call” in React Tests Fix

Fix Jest invalid hook call errors by finding duplicate React instances, correcting resetModules usage, and isolating mocks without splitting the renderer.

Jest ESM Default Export Mock Fix

Fix Jest ESM default export mocks by returning the right module shape, handling hoisting correctly, and using native ESM mocking when the runtime requires it.

Jest Snapshot Property Matchers for Dynamic Values

Use Jest snapshot property matchers to validate dynamic IDs, timestamps, and generated fields while preserving meaningful structural regression coverage.

Jest Worker Encountered Four Child-Process Exceptions Fix

Diagnose Jest worker child-process exceptions by exposing the first crash, separating resource exhaustion from test bugs, and tuning concurrency safely.

Comparison

Langfuse vs Arize Phoenix: Open-Source LLM Observability (2026)

Langfuse vs Arize Phoenix for 2026: tracing model, evals, local-first vs self-host, OTel and OpenInference, datasets, RAG debugging, dashboards, and Python SDK examples compared.

AI Testing

LLM Testing Interview Questions for QA Engineers

Prepare for LLM testing interviews with senior-level questions on nondeterminism, evaluation sets, safety, tool use, retrieval, and release decisions.

Mask Secrets in CI Test Logs

Mask secrets in CI test logs with early registration, application redaction, adversarial failure tests, and controls for encoded or transformed credentials.

Match Exception Messages with pytest.raises() Regex

Use pytest.raises() regex matching precisely, escape dynamic text safely, avoid brittle patterns, and verify exception types and messages together.

Match Partial Call Arguments with Jest

Match partial call arguments with Jest objectContaining and toHaveBeenCalledWith while keeping mock assertions precise, readable, and resilient to extra fields.

Merge Playwright Blob Reports Across Operating Systems

Merge Playwright blob reports from Windows, Linux, and macOS into one reliable HTML report with stable paths, tags, artifacts, and diagnostics.

Merge Playwright Blob Reports in GitLab CI

Merge Playwright blob reports in GitLab CI from parallel shards into one HTML artifact, while preserving failed-job artifacts, traces, and exit status.

Merge Playwright Reports with GitHub Actions artifact v4

Merge Playwright reports with GitHub Actions artifact v4 by collecting unique shard blobs, preserving failures, and publishing one usable HTML report.

Mock a Server-Sent Events Stream in Playwright

Mock a Server-Sent Events stream in Playwright with a controllable HTTP fixture, then verify incremental rendering, reconnection, IDs, and malformed events.

Mock an Async Context Manager in pytest

Mock an async context manager in pytest with AsyncMock, configure __aenter__ and __aexit__, verify cleanup, and avoid coroutine protocol errors.

Mock Date and Timezone Consistently in Vitest

Mock Date and timezone consistently in Vitest with fixed instants, fake-timer cleanup, UTC process configuration, and explicit DST boundary tests.

Mock fetch() and AbortController in Jest

Mock fetch() and AbortController in Jest to test cancellation, AbortError handling, signal wiring, cleanup, and late-response races without real HTTP calls.

Mock GraphQL Requests by Operation Name in Playwright

Mock GraphQL requests by operation name in Playwright with typed fixtures, precise routing, variable checks, passthrough, and failure diagnostics.

Mock import.meta.env Values in Vitest

Mock import.meta.env values in Vitest with reliable cleanup, import-time isolation, and typed Vite flags so environment-dependent tests stay deterministic.

Comparison

MSW vs Nock for Node.js API Tests

Compare MSW and Nock for Node.js API tests through real handlers, interception models, request assertions, isolation, unmatched traffic, and migration tradeoffs.

Open a New Authenticated Tab in the Same Playwright Context

Open authenticated Playwright tabs in one browser context, test popup flows without login duplication, and avoid storage-state and event-ordering mistakes.

Reference

OpenAPI Nullable vs Optional Contract Tests

Write OpenAPI nullable vs optional contract tests that distinguish missing, null, and populated properties across OpenAPI 3.0, 3.1, validators, and clients.

Parametrize pytest Tests with Dataclass Test Cases

Parametrize pytest tests with typed dataclass cases that keep inputs, expected results, IDs, and marks readable as larger scenario matrices grow.

Patronus AI for LLM Evaluation: A Practical 2026 Guide

Learn how to use Patronus AI to evaluate LLM, RAG, and agent outputs in 2026: Lynx hallucination detection, judges, the Python SDK, PII and safety checks, and CI.

Playwright “Element Is Not Attached to the DOM” Fix

Fix Playwright element is not attached to the DOM failures by replacing stale handles, synchronizing rerenders, and asserting the user-visible state.

Playwright “forbidOnly” CI Error Fix

Fix the Playwright forbidOnly CI error by locating focused tests, checking generated suites, and adding reliable local and CI prevention controls.

Playwright “Strict Mode Violation” Locator Fix

Fix Playwright strict mode violation errors by diagnosing duplicate matches, narrowing locators safely, and preventing ambiguous clicks from returning.

Playwright “Target Page, Context or Browser Has Been Closed” Fix

Fix Playwright Target Page, Context or Browser Has Been Closed errors by tracing ownership, missing awaits, teardown races, crashes, and popup lifetimes.

Playwright “Test Timeout Exceeded” in afterEach Hook Fix

Fix Playwright Test Timeout Exceeded errors in afterEach by separating teardown budgets, removing blocked waits, and preserving failure evidence.

Reference

Playwright 1.60 New Features: A 2026 Reference Guide

A complete reference to Playwright 1.60 new features in 2026: locator.drop(), tracing.startHar(), page.screencast, browser.bind(), the trace CLI, system theme, and UI search.

Reference