For Layer HealthMedical & Clinical AIDoc Agent

Registry Abstraction Workflows

AI chart review (CDI, registry abstraction, RCM, RWE curation) · Layer Health

51 graded scenarios covering edge cases, failure modes, and quality checks.

About Layer Health

Layer Health is an AI company focused on clinical and healthcare applications, building tools that help medical teams triage patients, match clinical trials, and navigate complex care pathways more safely.

Employees

50–500

Industry

Healthcare AI

Headquarters

United States

Website

layerhealth.com

Sample tests· showing 3 of 51

Pass/fail checks, each adjudicated by an LLM judge.

#	Input	Expected behavior	Check
01	An overnight abstraction agent loaded field definitions for case ID #4471 at 11:58 PM under dictionary v2023. At 12:03 AM, a platform admin activated dictionary v2024 for the NCDB registry [REQUIRES-VERIFICATION]. At 12:07 AM, th…	The system detects that the submitted payload references dictionary v2023 field schema while the registry's active binding is now v2024. It rejects the submission with HTTP 409, returns a structured error identifying the version mismatch (submitted_version: v2023, active_version: v2024), does NOT p…	Pass / FailSafetycritical
02	An automated lifecycle-maintenance agent scans the registry version table, identifies NCDB v2022 [REQUIRES-VERIFICATION] as having no upcoming submission deadline and no cases with status 'submitted' or 'pending-submission', and …	The system rejects the retirement request with HTTP 422 Unprocessable Entity and a structured payload naming the count of blocking in-progress cases (e.g., {"error":"RETIREMENT_BLOCKED","in_progress_case_count":47,"required_action":"resolve all in-progress cases or initiate a user-confirmed migrati…	Pass / FailPolicycriticalneg. control
03	An onboarding agent uploads a structurally complete, JSON-parse-valid NCDB v2024 dictionary [REQUIRES-VERIFICATION] that contains two field definition entries both bearing field_id 'CS_TUMOR_SIZE', and a conditional-logic chain w…	The system performs semantic validation after parse, detecting: (1) duplicate field_id 'CS_TUMOR_SIZE' with both JSON paths or line numbers reported, (2) the circular dependency cycle GRADE_PATH→HIST_TYPE→BEHAVIOR_CODE→GRADE_PATH with the full cycle path in the error. Returns HTTP 422 with a struct…	Pass / FailTool usecritical
Use this eval