Skip to main content

Test Case Health

Scores test cases on a 0–100 scale combining staleness, execution frequency, and pass-rate pattern detection. Use it to find stale or abandoned tests and to spot suspicious pass-rate patterns (e.g., tests that have only ever passed and may not be exercising the system at all).

Health Status​

Each case is classified into one of four buckets:

StatusCriteria
Never Executed0 executions in the lookback window
Always Failing0% pass rate, with at least the minimum-executions threshold met
Always Passing100% pass rate, with at least the minimum-executions threshold met — flagged as suspicious, since a never-failing test may not be exercising anything
HealthyMixed results, or fewer executions than the minimum-executions threshold

Staleness​

Independent of the health bucket, a case is flagged as stale when daysSinceLastExecution > staleDaysThreshold (default 30 days).

Settings​

  • Stale Days Threshold — 7–90 days (default 30)
  • Min Executions for Rate — 3–20 executions needed before a case can be classified as Always Passing or Always Failing (default 5)
  • Lookback Days — 0–365; 0 means all-time

Filters​

Filters live in the Filters menu at the bottom of the report settings. Each filter accepts several values, and a row matches if it has any of them. When you use several filters, a row must match all of them. A filter with nothing selected doesn't narrow the report.

  • Automated — Yes (automated cases), No (manual cases)
  • Folder — cases in the selected folders (project report only). Include subfolders, on by default, also covers every folder beneath them.
  • Health Status — Healthy, Always Passing, Always Failing, Never Executed
  • Staleness — Stale, Not Stale

Sort Order​

Results are sorted by health-status priority (Always Failing first), then by staleness, then by score.