Blog
QA testing insights, AI agent tips, and skill development guides
All Articles
Page 13 of 36
Testing a Token-Bucket API Rate Limiter
Test a token-bucket API rate limiter with deterministic clocks, burst and refill assertions, concurrent requests, retry headers, and distributed-state checks.
Testing Agent Memory for Cross-User Leakage
Test agent memory for cross-user leakage with canary secrets, paired identities, retrieval tracing, cache isolation, concurrency, and deterministic evidence.
Testing Agent Permission-Boundary Violations
Test agent permission-boundary violations by proving unauthorized tools never execute, including indirect prompts, stale grants, and partial-failure paths.
Testing Agent Plan Recovery After a Tool Failure
Test agent plan recovery after tool failure with fault injection, trajectory assertions, bounded replanning, and outcome-based evaluation for AI agents.
Testing Agent Tool Selection with Distractor Tools
Test AI agent tool selection against plausible distractor tools, measure selection and argument errors, and build reproducible adversarial evaluations.
Testing Agent Tool-Call Retry Behavior
Test agent tool-call retry behavior with scripted transient failures, bounded backoff, idempotency checks, trace assertions, and deterministic terminal outcomes.
Testing AI-Agent Infinite-Loop Detection
Test AI-agent infinite-loop detection with step budgets, repeated-action fingerprints, progress signals, adversarial tools, and deterministic regression cases.
Testing an AWS Lambda Dead-Letter Queue Locally
Test an AWS Lambda dead-letter queue locally with LocalStack, real failed asynchronous invocations, SQS assertions, retry-aware polling, and clean isolation.
Testing an Embedding-Model Migration for Regressions
Test an embedding-model migration with paired recall, ranking overlap, latency, vector validation, shadow indexes, and controlled rollout gates.
Testing an LLM Guardrail’s False-Positive Rate
Test an LLM guardrail’s false-positive rate with safe-request datasets, confidence intervals, slice analysis, threshold tuning, and production feedback.
Testing an LLM Time-to-First-Token SLA
Test an LLM time-to-first-token SLA with precise streaming boundaries, controlled workloads, percentile gates, concurrency, warmups, and diagnostic telemetry.
Testing API Content Negotiation with the Accept Header
Test API content negotiation with Accept header quality weights, wildcards, media parameters, 406 responses, response Content-Type, and cache safety.
Testing API Rate-Limit Reset Headers
Testing API rate-limit reset headers correctly verifies remaining quotas, reset timing, Retry-After behavior, and safe client recovery from HTTP 429.
Testing Application Behavior During Read-Replica Lag
Test application behavior during read-replica lag with paused PostgreSQL replay, read-after-write routing, stale-state assertions, fallback, and recovery checks.
Testing Autocomplete Keyboard Accessibility
Test autocomplete keyboard accessibility across arrows, Enter, Escape, focus, ARIA state, and screen-reader announcements with resilient automation.
Testing Closed Shadow Roots with Playwright: Practical Workarounds
Testing closed shadow roots with Playwright requires public-behavior tests or controlled instrumentation. Learn workable seams without brittle private selectors.
Testing Context Loss During Multi-Agent Handoffs
Test multi-agent handoff context loss with constraint canaries, evidence lineage, mutation cases, and executable assertions that expose silent delegation gaps.
Testing Cursor-Pagination API Boundaries
Test cursor-pagination API boundaries with stable ordering, opaque cursor validation, empty and terminal pages, mutation checks, and traversal invariants.
Testing Data-Grid Keyboard Navigation Accessibility
Test data-grid keyboard navigation accessibility across arrows, Home, End, paging, selection, editing, focus visibility, and virtualized rows.
Testing Database Deadlock Retry Logic
Test database deadlock retry logic by forcing a real PostgreSQL cycle, checking SQLSTATE 40P01, bounded backoff, transaction replay, and side effects.
Testing Database Unique-Constraint Race Conditions
Test database unique-constraint race conditions with synchronized PostgreSQL inserts, SQLSTATE assertions, rollback checks, and recovery verification.
Testing Deleted-Document Tombstones in RAG
Test deleted-document tombstones in RAG across vector retrieval, caches, citations, races, and reindexing so removed sources cannot resurface.
Testing Elasticsearch Typo Tolerance
Test Elasticsearch typo tolerance with fuzziness, exact-match ranking, edit-distance boundaries, analyzers, realistic queries, and deterministic assertions.
Testing ETag and If-Match Concurrency Control
Test ETag and If-Match concurrency control with stale writes, strong validators, 412 responses, atomic races, and evidence that lost updates are blocked.
Testing Eventually Consistent APIs with Polling
Test eventually consistent APIs with deadline-based polling, classified responses, diagnostic timeouts, and stable assertions for delayed state changes.
Testing GitHub Webhook Redelivery and Signatures
Test GitHub webhook redelivery and signatures with raw-body HMAC verification, stable delivery IDs, idempotent processing, and replay scenarios.
Testing GraphQL Partial Data and Errors Together
Test GraphQL partial data and errors together by asserting null propagation, error paths, extensions, and client behavior without discarding useful fields.
Testing GraphQL Persisted Queries
Test GraphQL persisted queries across hash misses, registration, cache hits, tampering, rollout compatibility, and CDN-safe request behavior.
Testing GraphQL Query Complexity Limits
Test GraphQL query complexity limits with calibrated field costs, fragment and variable cases, exact rejection boundaries, and resolver-side proof.
Testing GraphQL Subscription Reconnection
Test GraphQL subscription reconnection across disconnects, authentication refresh, replay gaps, duplicate events, retry policies, and terminal closures.
Testing gRPC Bidirectional-Stream Cancellation
Test gRPC bidirectional-stream cancellation with real client cancellation, CANCELLED status, server cleanup, partial messages, upstream propagation, and races.
Testing gRPC DEADLINE_EXCEEDED Retry Behavior
Test gRPC DEADLINE_EXCEEDED retry behavior with deterministic clocks, fault injection, retry budgets, and assertions that prevent duplicate side effects.
Testing Guardrail False Negatives with Jailbreak Prompts
Test guardrail false negatives with jailbreak prompts using policy-labeled datasets, layered attacks, calibrated graders, and release-ready safety metrics.
Testing HTTP Range Requests for File Downloads
Test HTTP Range requests for file downloads with precise byte boundaries, 206 and 416 assertions, validators, multipart cases, and corruption-resistant checks.
Testing Hybrid Search Weighting in RAG
Test hybrid search weighting in RAG with judged query sets, lexical and vector diagnostics, score normalization, rank fusion sweeps, and retrieval guardrails.
Testing i18n Pluralization Rules in React
Test React i18n pluralization for zero, one, few, many, other, and ordinals with i18next, CLDR-driven locale matrices, and real browser rendering.
Testing Idempotency Keys with Concurrent API Requests
Test idempotency keys under concurrent API requests, proving one side effect, stable replay responses, payload conflict handling, and atomic persistence.
Testing Infinite-Scroll Screen-Reader Announcements
Test infinite-scroll screen-reader announcements with stable live regions, focus-safe loading, Playwright checks, and practical assistive-tech coverage.
Testing JSON Patch API Operations
Testing JSON Patch API operations validates add, remove, replace, move, copy, and test semantics, including arrays, atomic failures, and ETags.
Testing JWT Key Rotation and JWKS Caching
Test JWT key rotation and JWKS caching with overlapping keys, unknown kid refreshes, cache expiry, issuer outages, and strict signature verification.
Testing Live-Region Toast Notifications
Test live-region toast notifications for correct status or alert semantics, announcement timing, duplicate suppression, focus, and queued updates.
Testing LLM Function-Call Argument Validation
Test LLM function-call argument validation with JSON Schema and Ajv, covering missing, invalid, extra, coerced, malicious, and semantically unsafe inputs.
Testing LLM JSON Schema Enum Compliance
Test LLM JSON Schema enum compliance with strict validation, adversarial prompts, normalization boundaries, reproducible sampling, and failure diagnostics.
Testing LLM Streaming Chunk Order
Test LLM streaming chunk order by parsing real SSE boundaries, tracking sequence metadata, detecting gaps and duplicates, and validating safe replay and completion.
Testing LLM-Judge Rubric Score Consistency
Test LLM-judge rubric score consistency by measuring repeated-score variance, ordinal agreement, drift, and unstable rubric boundaries before release.
Testing Metadata-Filtered Retrieval in RAG
Test RAG metadata-filtered retrieval for tenant, date, and document-type boundaries with adversarial fixtures, SQL checks, and recall diagnostics.
Testing Modal Focus-Trap Accessibility
Test modal focus-trap accessibility with Playwright by verifying initial focus, Tab cycling, Escape behavior, background isolation, and focus restoration.
Testing Multilingual RAG Retrieval Quality
Test multilingual RAG retrieval quality with language-pair recall, ranking, grounding, translation variants, and production-focused failure analysis.
Testing Multipart File-Upload Size Limits
Test multipart file-upload size limits at exact boundaries, including MIME overhead, deceptive filenames, truncated bodies, cleanup, and proxy behavior.
Testing OAuth 2.0 Refresh-Token Rotation
Test OAuth 2.0 refresh-token rotation for one-time use, concurrent reuse detection, expiration, token-family revocation, and secure client recovery paths.