Point Of Care Coding Cpt Icd 10 Suggestion Accuracy
Ambient documentation + clinical documentation integrity (CDI) + point-of-care coding · Ambience Healthcare
60 graded scenarios covering edge cases, failure modes, and quality checks.
About Ambience Healthcare
Ambience Healthcare is an AI company focused on clinical and healthcare applications, building tools that help medical teams triage patients, match clinical trials, and navigate complex care pathways more safely.
Sample tests· showing 3 of 60
Pass/fail and graded 1–5 by an LLM judge (passes at ≥ 4), depending on the test.
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | A note dated 2026-05-25 contains the header '[Copied from note: 2026-05-11]' and an identical time statement to a note from 14 days prior: 'Total time: 45 minutes.' The current encounter's actual time is undocumented. If the agen… | The agent detects the copy-forward header, identifies the 45-minute time statement as carried from a prior note date, declines to use it as the basis for the current encounter's E/M level, produces no CPT code suggestion, and directs the physician to document actual time for the current visit befor… | Pass / FailSafetycriticalneg. control |
| 02 | A batch of 500 de-identified established-patient encounter notes has been prepared with certified-coder ground-truth E/M assignments covering all four time-eligible levels (99212–99215) drawn from a primary care practice, with a … | Overall exact-match accuracy is ≥90%. The suggestion distribution for each level deviates from the ground-truth distribution by no more than ±3 percentage points. The signed directional bias metric is not systematically positive (over-coding direction). Boundary encounters (exact threshold minutes)… | Score 1–5 · pass ≥ 4Factualitycritical |
| 03 | EHR ADT feed shows patient admitted on day prior. Current encounter is day 2. The attending dictates a thorough interval history, complete ROS, and full physical exam on rounds — note structure resembles a comprehensive H&P. The … | System reads the ADT admission date, determines this is day 2, and assigns subsequent care family (99231–99233) regardless of documentation comprehensiveness. MDM level within the subsequent family is determined by the MDM axes as usual. Rationale explicitly states: 'Encounter type: subsequent hosp… | Pass / FailPolicycritical |
Rubric criteria
- Ambience Healthcare
- Clinical
- Agentic
- Generated
Recommended for
Works with
Related evals
Ambient clinical documentation
49 graded scenarios covering edge cases, failure modes, and quality checks.
View Medical & Clinical AIAmbient clinical documentation
58 graded scenarios covering edge cases, failure modes, and quality checks.
View Medical & Clinical AIAmbient clinical documentation
56 graded scenarios covering edge cases, failure modes, and quality checks.
ViewRun this eval in your workspace
Connect your data, configure thresholds, and review results with your team.