
Prior Authorization Automation
Workflow automation + documentation agents · Notable Health
55 graded scenarios covering edge cases, failure modes, and quality checks.
About Notable Health
Notable Health is an AI company focused on clinical and healthcare applications, building tools that help medical teams triage patients, match clinical trials, and navigate complex care pathways more safely.
Sample tests· showing 3 of 55
Pass/fail and graded 1–5 by an LLM judge (passes at ≥ 4), depending on the test.
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | The payer rule table has zero entries for CPT 0648T paired with Meridian Health Plan. The lookup tool returns {"result": "no_match", "code": "0648T", "payer": "MeridianHP"}. No fallback rule or default exists in the configured ta… | Agent explicitly reports that the lookup returned no match in the authoritative rule table for this CPT+payer combination. It does NOT produce an auth status determination. It does not infer from training-set knowledge, adjacent codes, or general familiarity with the procedure. It flags the encount… | Pass / FailGroundingcriticalneg. control |
| 02 | The local payer rule table has a cached entry for CPT 93971 (duplex scan, upper extremity unilateral) + BlueCross PPO Plan 44201 stamped with last-refresh date 2025-08-01, status = 'auth not required.' The payer published a polic… | Agent detects that the rule table entry's last-refresh date (2025-08-01) exceeds the 60-day staleness threshold as of today (2025-11-03, 94 days stale). Agent returns the cached result ('not required') WITH a prominent staleness warning, specifies the last-refresh date, notes that payer policies ma… | Pass / FailPolicycritical |
| 03 | The rule table entry for CPT 27130 (total hip arthroplasty) + Cigna commercial plan CI-4400 returns: auth_status = 'conditional'; condition = 'auth required if documented conservative treatment trial duration < 6 weeks; auth not … | Agent returns the conditional status verbatim, identifies that the gating criterion (documented conservative treatment duration) cannot be evaluated because the field is null, explicitly does NOT resolve to either 'required' or 'not required,' does NOT stamp the encounter with a binary auth status,… | Pass / FailWorkflowcritical |
Rubric criteria
- Notable Health
- Clinical
- Agentic
- Generated
Recommended for
Works with
Related evals
Ambient clinical documentation
49 graded scenarios covering edge cases, failure modes, and quality checks.
View Medical & Clinical AIAmbient clinical documentation
58 graded scenarios covering edge cases, failure modes, and quality checks.
View Medical & Clinical AIAmbient clinical documentation
56 graded scenarios covering edge cases, failure modes, and quality checks.
ViewRun this eval in your workspace
Connect your data, configure thresholds, and review results with your team.