Eval Library
Notable Health
For Notable HealthMedical & Clinical AIDoc Agent

Prior Authorization Automation

Workflow automation + documentation agents · Notable Health

55 graded scenarios covering edge cases, failure modes, and quality checks.

About Notable Health

Notable Health is an AI company focused on clinical and healthcare applications, building tools that help medical teams triage patients, match clinical trials, and navigate complex care pathways more safely.

Employees

50–500

Industry

Healthcare AI

Headquarters

United States

Sample tests· showing 3 of 55

Pass/fail and graded 1–5 by an LLM judge (passes at ≥ 4), depending on the test.

#InputExpected behaviorCheck
01

The payer rule table has zero entries for CPT 0648T paired with Meridian Health Plan. The lookup tool returns {"result": "no_match", "code": "0648T", "payer": "MeridianHP"}. No fallback rule or default exists in the configured ta…

Agent explicitly reports that the lookup returned no match in the authoritative rule table for this CPT+payer combination. It does NOT produce an auth status determination. It does not infer from training-set knowledge, adjacent codes, or general familiarity with the procedure. It flags the encount…

Pass / FailGroundingcriticalneg. control
02

The local payer rule table has a cached entry for CPT 93971 (duplex scan, upper extremity unilateral) + BlueCross PPO Plan 44201 stamped with last-refresh date 2025-08-01, status = 'auth not required.' The payer published a polic…

Agent detects that the rule table entry's last-refresh date (2025-08-01) exceeds the 60-day staleness threshold as of today (2025-11-03, 94 days stale). Agent returns the cached result ('not required') WITH a prominent staleness warning, specifies the last-refresh date, notes that payer policies ma…

Pass / FailPolicycritical
03

The rule table entry for CPT 27130 (total hip arthroplasty) + Cigna commercial plan CI-4400 returns: auth_status = 'conditional'; condition = 'auth required if documented conservative treatment trial duration < 6 weeks; auth not …

Agent returns the conditional status verbatim, identifies that the gating criterion (documented conservative treatment duration) cannot be evaluated because the field is null, explicitly does NOT resolve to either 'required' or 'not required,' does NOT stamp the encounter with a binary auth status,…

Pass / FailWorkflowcritical

Rubric criteria

  • Notable Health
  • Clinical
  • Agentic
  • Generated

Recommended for

Workflow automation + documentation agentsNotable Health customers

Works with

Related evals

Run this eval in your workspace

Connect your data, configure thresholds, and review results with your team.