Skip to main content

Blog

QA testing insights, AI agent tips, and skill development guides

All Articles

Page 10 of 37

Guide
2026-07-15

Claude Skill Not Triggering: The Complete Troubleshooting Guide

Get a Claude skill not triggering fix: diagnose discovery and description issues, repair execution failures, and prove activation with a QA-focused test workflow.

Comparison
2026-07-15

Claude Skills vs Cursor Rules vs Copilot Instructions: Which to Use in 2026

Compare Claude Skills vs Cursor Rules vs Copilot Instructions for QA automation, then choose the right format for reliable, maintainable agent guidance.

Guide
2026-07-15

Cline and Roo Code Rules: Configuration Guide for Test Automation

Configure Cline rules and Roo Code modes for test automation: .clinerules, conditional paths, .roomodes, fileRegex, and QA-safe agent guardrails.

Guide
2026-07-15

copilot-instructions.md for Testing Teams: GitHub Copilot Custom Instructions Guide

Learn GitHub Copilot custom instructions testing patterns that produce safer test code, consistent reviews, and repository-aware automation.

Guide
2026-07-15

Cursor Rules for Test Automation: The .cursor/rules Complete Guide

Master the cursor rules file test automation workflow with scoped MDC rules that help agents write reliable UI, API, and contract tests faster.

Guide
2026-07-15

Distributing Agent Skills Across a Team: Monorepos, Git, and Version Control

Learn how to share agent skills across a team monorepo with Git, ownership, validation, releases, and safe rollbacks for reliable QA automation.

Guide
2026-07-15

GEMINI.md Configuration Guide: Customizing Gemini CLI for Testing Workflows

Configure Gemini CLI with GEMINI.md for QA workflows: hierarchy, imports, settings.json context.fileName, and test-automation rules that stick.

Guide
2026-07-15

GitHub Copilot Coding Agent: Setup Guide for Testing Repositories

Complete copilot coding agent setup for testing repositories: custom instructions, setup-steps.yml, MCP, and issue patterns that keep CI green.

Reference
2026-07-15

GitHub Copilot Path-Specific Instructions: instructions.md Files and applyTo Explained

Master GitHub Copilot path-specific instructions: .instructions.md files, applyTo globs, and QA-focused rules for tests, fixtures, and reviews.

Guide
2026-07-15

How to Create a Claude Skill (SKILL.md): The Complete Guide

Learn how to create a Claude skill with reliable SKILL.md structure, QA-focused workflows, trigger tests, reusable resources, and team validation.

Tutorial
2026-07-15

How to Create an MCP Server for QA Testing Tools

Learn how to create MCP server testing tools that let AI agents discover tests, run safe subsets, inspect failures, and return structured evidence.

Tutorial
2026-07-15

How to Publish an AI Agent Skill: From SKILL.md to a Public Directory

A practical guide on how to publish AI agent skill packages from SKILL.md to a trusted directory, with QA validation, security checks, and release governance.

Tutorial
2026-07-15

How to Test Agent Skills: Evals, Iteration, and Regression Checks

Learn how to test agent skills with repeatable evals, QA-grade fixtures, scoring rubrics, and regression gates that make every iteration safer.

Guide
2026-07-15

Progressive Disclosure in Agent Skill Design: Small Context, Full Power

Master progressive disclosure agent skills that keep QA agents focused, load test knowledge on demand, and deliver reliable automation with less context.

Comparison
2026-07-15

SKILL.md vs MCP Server: When to Use Which for AI Agent Capabilities

Understand the SKILL.md vs MCP server difference and choose the right approach for portable QA guidance, live testing tools, or a maintainable hybrid.

Reference
2026-07-15

The Agent Skills Open Standard: Write One Skill, Run It Everywhere

Learn how agent skills open standard portability lets QA teams write one SKILL.md once and run it across Claude, Cursor, Codex, and other agents.

Tutorial
2026-07-15

Validating SKILL.md in CI: Linting, Schema Checks, and Quality Gates

Validate SKILL.md in a CI pipeline with linting, schema checks, and quality gates so QA teams ship agent skills that stay reliable on every PR.

Guide
2026-07-15

Windsurf Rules and Memories: Configuration Guide for Test Automation Teams

Configure Windsurf Cascade rules, memories, and AGENTS.md for QA teams: activation modes, paths, budgets, and test automation patterns that stick.

Guide
2026-07-14

Add MCP Conformance Tests to GitHub Actions with Failure Baselines

Add pinned MCP conformance tests to GitHub Actions, preserve raw evidence, and govern expected failures without hiding regressions or stale exceptions.

Guide
2026-04-13

AI Agent Evaluation Guide for Tools, Trajectories, and Task Success

Evaluate AI agents across task outcomes, tool selection and arguments, trajectories, environment state, repeated trials, safety, latency, and cost.

AI Testing
2026-02-17

AI Test Automation Tools and Workflows for QA Teams in 2026

A rigorous guide to selecting and governing AI test automation tools, testing AI systems, review workflows, CI gates, security, drift, metrics, and adoption.

Strategy
2026-07-14

AI4Testing vs Testing AI: Two Different QA Strategies Explained

Compare AI4Testing with Testing AI through scope, ownership, evidence, examples, risks, metrics, and a practical decision model for QA teams in 2026.

Guide
2026-03-24

Contextual Precision vs Recall vs Relevancy for RAG Testing

Compare RAG context precision, recall, and relevancy without conflating ranking, evidence coverage, or focus, using reproducible fixtures and CI checks.

Guide
2026-07-14

Debug Playwright Tests with --debug=cli and Agent Trace Commands

Pause a Playwright test for agent attachment, inspect it with playwright-cli, analyze trace.zip from the terminal, and record separate agent session traces.

Guide
2026-07-14

DeepEval 3 to 4 Migration Guide for Traces and Multi-Turn Goldens

Migrate DeepEval 3 suites to DeepEval 4 with pinned environments, trace parity, multi-turn goldens, shadow CI, failure triage, and rollback controls.

Tutorial
2026-07-05

DeepEval 4 Tutorial for Pytest-Style LLM, RAG, and Agent Testing

Build DeepEval 4.1 tests for LLMs, RAG, agents, conversations, synthetic datasets, custom metrics, failure diagnosis, and CI quality gates.

Tutorial
2026-07-14

DeepEval ConversationSimulator Tutorial with Synthetic Users

Build DeepEval ConversationSimulator tests with conversational goldens, stateful callbacks, controlled stopping, evaluation metrics, CI, and failure analysis.

Guide
2026-07-13

DeepEval TaskCompletionMetric: Trace Setup and Failure Analysis

Implement DeepEval TaskCompletionMetric with complete agent traces, calibrated judges, CI gates, outcome evidence, and systematic failure diagnosis.

Comparison
2026-07-14

Deterministic Graders vs LLM Judges vs Human Review

Choose deterministic graders, calibrated LLM judges, or human review using task risk, objective evidence, agreement checks, cost, and escalation rules.

Guide
2026-07-14

Evaluate Codex vs Claude Coding Agents with Promptfoo

Build a fair Promptfoo coding-agent evaluation for Codex and Claude using controlled tasks, sandboxes, graders, repeated trials, and review.

Tutorial
2026-07-14

Generate Synthetic RAG Testsets with Ragas and Your Documents

Generate, validate, and govern synthetic RAG testsets with current Ragas concepts while controlling leakage, sampling bias, privacy, and held-out use.

Guide
2026-07-14

High Answer Relevance but Low Faithfulness: Diagnose Wrong RAG Answers

Diagnose fluent, on-topic RAG answers that are unsupported by retrieved evidence using atomic claim tracing, controlled context tests, and release gates.

Tutorial
2026-07-14

How to Build an LLM Eval Harness That Matches Production Behavior

Build an LLM eval harness that exercises the production application path, isolates state, records versions and traces, repeats trials, and gates releases.

Tutorial
2026-07-14

How to Install Playwright CLI Skills in Codex and Claude Code

Install Playwright CLI skills for Codex and Claude Code, verify agent discovery, run a browser smoke test, and fix common skill setup failures.

Tutorial
2026-07-14

How to Install the DeepEval Skill in Codex, Claude Code, and Cursor

Install and verify the official DeepEval skill in Codex, Claude Code, and Cursor, then govern permissions, eval loops, updates, CI, and rollback.

Guide
2026-07-14

How to Tell Whether a RAG Failure Comes from Retrieval or Generation

Localize RAG defects with controlled context substitutions, claim evidence, retrieval labels, and release checks that separate retrieval from generation.

Playbook
2026-02-19

How to Test AI-Generated Code: A Practical SDET Review Playbook

Review and test AI-generated code with a risk-based SDET workflow covering diff scope, independent oracles, security, Playwright checks, CI, and merge gates.

Tutorial
2026-07-14

Install Promptfoo Agent Skills in Codex and Claude Code

Install Promptfoo agent skills in Codex and Claude Code, verify routing and config output, and govern permissions, upgrades, and repository policy.

Certification
2026-07-14

ISTQB CT-AI v2.0 Guide for QA Engineers: What Changed in 2026

Understand the ISTQB CT-AI v2.0 scope, syllabus changes, exam facts, practical exercises, migration choices, and a focused study plan for QA engineers.

Guide
2026-03-17

LLM Testing Complete Guide: Evals, Agents, RAG, and Quality Gates

Build reliable LLM tests for prompts, agents, RAG, multi-turn workflows, security, monitoring, CI quality gates, cost, and eval-platform migration.

Guide
2026-06-14

MCP Server Testing Complete Guide for Protocol, Tools, and Security

Test MCP servers across lifecycle, transports, contracts, conformance, Inspector, authentication, resilience, observability, and security in 2026.

Tutorial
2026-07-06

npx playwright init-agents Setup Guide for Agentic Test Loops

Set up Playwright test-agent definitions for VS Code, Claude Code, Codex, or OpenCode, verify the generated files, and diagnose setup failures.

Guide
2026-07-14

OpenAI Evals Platform Shutdown: Migration Checklist for November 2026

Migrate OpenAI Evals before the November 2026 shutdown with export, Promptfoo, code-first parity, CI, grader validation, and rollback checklists.

Tutorial
2026-07-14

Playwright 1.61 WebAuthn Passkey Testing with Virtual Authenticators

Test passkey registration and sign-in with the cross-browser Credentials virtual authenticator added in Playwright 1.61, including reuse and failure diagnosis.

Guide
2026-04-01

Playwright BrowserContext Guide for Isolation and Parallel Sessions

Use Playwright BrowserContext for clean test isolation, independent multi-user sessions, reusable auth state, context-wide controls, and safe parallel execution.

Guide
2026-07-14

Playwright CLI Accessibility Snapshots and Element References Explained

Understand Playwright CLI accessibility snapshots, use short-lived element refs safely, scope agent context, and troubleshoot stale or missing references.

Guide
2026-03-24

Playwright CLI Complete Guide for Browser Automation and AI Agents

Use Playwright CLI for agent-driven browser automation, snapshots, sessions, debugging, traces, video, secure CI workflows, and MCP decisions in 2026.

Guide
2026-07-14

Playwright Generator Agent Guide for Maintainable Test Code

Turn reviewed Markdown plans into maintainable Playwright tests with the Generator agent, live verification, fixture reuse, and disciplined code review.

Troubleshooting
2026-07-07

Playwright Healer Agent Guide for Repairing Failed Browser Tests

Use the Playwright Healer agent to replay a named failure, inspect current UI behavior, review a minimal patch, and reject repairs that hide regressions.

Tutorial
2026-07-14

Playwright localStorage and sessionStorage API Guide for Version 1.61

Use Playwright 1.61 page.localStorage and page.sessionStorage to inspect, seed, clear, and diagnose origin-scoped browser state without page.evaluate boilerplate.

QA Testing Blog Articles, Page 10 | QASkills.sh