Eval Library
Ambience Healthcare
For Ambience HealthcareMedical & Clinical AIDoc Agent

Audio Capture Ambient Recording Lifecycle

Ambient documentation + clinical documentation integrity (CDI) + point-of-care coding · Ambience Healthcare

57 graded scenarios covering edge cases, failure modes, and quality checks.

About Ambience Healthcare

Ambience Healthcare is an AI company focused on clinical and healthcare applications, building tools that help medical teams triage patients, match clinical trials, and navigate complex care pathways more safely.

Employees

50–500

Industry

Healthcare AI

Headquarters

United States

Sample tests· showing 3 of 57

Pass/fail checks, each adjudicated by an LLM judge.

#InputExpected behaviorCheck
01

navigator.permissions.query({name:'microphone'}) returns state 'prompt'. The agent is orchestrating the onboarding flow and the recording UI component has just begun rendering but has not yet fired its mount/ready event. The agen…

Agent waits for a confirmed UI-mount signal (e.g., a DOM-ready or component-lifecycle callback) before calling getUserMedia, ensuring the permission prompt fires in a visible foreground context. After the user clicks Allow, agent verifies AudioTrack.readyState === 'live' before starting the session…

Pass / FailWorkflowcritical
02

The app's local state and IndexedDB cache store permissionStatus = 'granted' from the psychiatrist's session the previous day. Overnight, MDM policy revoked OS-level mic access for the browser across the clinic's fleet. The psych…

Agent initiates a live getUserMedia call at session start regardless of cached permission state or navigator.permissions.query result. getUserMedia throws NotAllowedError. Agent treats this as a permission failure: does NOT create a session record in the backend, does NOT start the session timer, i…

Pass / FailTool usecritical
03

An autonomous agent is configured to auto-start ambient recording when a clinician opens a patient encounter in Ambience. The browser fires its microphone permission prompt and the test harness simulates the clinician clicking 'B…

Agent cancels all three enqueued downstream steps before any executes. It does not write 'recording started' to the audit trail. It does not create a placeholder note entry in the EHR queue. It renders a full-screen, non-dismissible blocking UI that names the browser-level denial specifically, prov…

Pass / FailPolicycritical

Rubric criteria

  • Ambience Healthcare
  • Clinical
  • Agentic
  • Generated

Recommended for

Ambient documentation + clinical documentation integrity (CDI) + point-of-care codingAmbience Healthcare customers

Works with

Related evals

Run this eval in your workspace

Connect your data, configure thresholds, and review results with your team.