E M Level Determination Mdm And Time Based
Ambient documentation + clinical documentation integrity (CDI) + point-of-care coding · Ambience Healthcare
55 graded scenarios covering edge cases, failure modes, and quality checks.
About Ambience Healthcare
Ambience Healthcare provides an AI platform for documentation, coding, and clinical workflow in health systems. It integrates with major EHRs across outpatient, emergency, and inpatient settings.
Industry
Healthcare AI / Clinical Documentation and Coding
Headquarters
San Francisco, CA
Website
www.ambiencehealthcare.comSample tests· showing 3 of 55
Pass/fail and graded 1–5 by an LLM judge (passes at ≥ 4), depending on the test.
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | An established patient presents with sore throat, fever, and bilateral tonsillar exudate. The provider orders a rapid strep antigen test, reviews the result (negative) during the visit, and despite the negative result prescribes … | Agent classifies Problems as Minimal (one self-limited/minor problem: pharyngitis). Agent then evaluates the Data column as Limited (one diagnostic test ordered and reviewed by the treating provider: rapid strep antigen test). Agent evaluates Risk as Low (prescription drug management: azithromycin)… | Pass / FailFactualitycritical |
| 02 | An established patient is seen exclusively for acute URI. The encounter transcript contains no provider mention of hypertension, type 2 diabetes, or hyperlipidemia and no medication review, adjustment, or counseling for any chron… | Agent uses only the encounter transcript as the source of truth for addressed problems. It determines that one self-limited problem (URI) was addressed and that HTN, T2DM, and HLD appear in the EHR active problem list but were not addressed in the encounter (provider explicitly stated 'no changes t… | Pass / FailGroundingcritical |
| 03 | An established patient who received a kidney transplant two years prior is on tacrolimus 2 mg BID and mycophenolate mofetil 750 mg BID for immunosuppression. She presents with three days of nasal congestion, mild sore throat, and… | Agent identifies the immunosuppressed status (tacrolimus plus mycophenolate, post-renal transplant) as a patient-context modifier that elevates the presenting problem complexity beyond self-limited/minor — at minimum to a chronic illness with potential for serious complication or an acute illness i… | Pass / FailFactualityhigh |
How this eval is graded
Pass/fail and graded 1–5 by an LLM judge (passes at ≥ 4), depending on the test.
Grade the agent's response for this case against the example's expected.ideal_behavior and expected.rubric. Score 1-5 (4+ passes). Penalize any behavior matching expected.failure_modes, and penalize over-eager or unsafe autonomous actions. For negative-control cases (metadata.is_negative_control=true), the correct behavior is to refuse, ask, or abstain.
Pass threshold: a criterion passes at a judge score of 4 or higher.
Rubric criteria
- Ambience Healthcare
- Clinical
- Agentic
- Generated
Recommended for
Works with
Related evals
Ambient clinical documentation
49 graded scenarios covering edge cases, failure modes, and quality checks.
View Medical & Clinical AIAmbient clinical documentation
58 graded scenarios covering edge cases, failure modes, and quality checks.
View Medical & Clinical AIAmbient clinical documentation
56 graded scenarios covering edge cases, failure modes, and quality checks.
ViewFrequently asked questions
What does the E M Level Determination Mdm And Time Based eval for Ambience Healthcare Ambient documentation + clinical documentation integrity (CDI) + point-of-care coding test?+
55 graded scenarios covering edge cases, failure modes, and quality checks.
How is the E M Level Determination Mdm And Time Based eval scored?+
Pass/fail and graded 1–5 by an LLM judge (passes at ≥ 4), depending on the test. The judge rubric: Grade the agent's response for this case against the example's expected.ideal_behavior and expected.rubric. Score 1-5 (4+ passes). Penalize any behavior matching expected.failure_modes, and penalize over-eager or unsafe autonomous actions. For negative-control cases (metadata.is_negative_control=true), the correct behavior is to refuse, ask, or abstain. A criterion passes at a judge score of 4 or higher.
How many test cases does this eval pack include?+
The E M Level Determination Mdm And Time Based pack for Ambience Healthcare Ambient documentation + clinical documentation integrity (CDI) + point-of-care coding contains 55 test cases. 3 sample cases are shown free on this page; the full set runs in a Corsac workspace.
How do I run this eval?+
Sign up for Corsac, connect your model or agent endpoint, and run the E M Level Determination Mdm And Time Based pack as-is or after customizing thresholds. Results land in your workspace with per-case scores, and you can gate releases on the pack in CI via the REST API.
Run this eval in your workspace
Connect your data, configure thresholds, and review results with your team.