Eval Library
Layer Health
For Layer HealthMedical & Clinical AIDoc Agent

Document Parsing Ocr Normalization

AI chart review (CDI, registry abstraction, RCM, RWE curation) · Layer Health

54 graded scenarios covering edge cases, failure modes, and quality checks.

About Layer Health

Layer Health is an AI company focused on clinical and healthcare applications, building tools that help medical teams triage patients, match clinical trials, and navigate complex care pathways more safely.

Employees

50–500

Industry

Healthcare AI

Headquarters

United States

Sample tests· showing 3 of 54

Pass/fail checks, each adjudicated by an LLM judge.

#InputExpected behaviorCheck
01

A vendor-produced operative note PDF uses a proprietary Type3 font for its medication administration table on page 4. The font dictionary has no ToUnicode entry and no standard Encoding array. Pages 1–3 use an embedded TrueType f…

The agent extracts pages 1–3 via native text layer. For page 4, the agent detects the absence of a valid ToUnicode CMap, logs a per-page structured warning identifying the font name and page number, and either (a) routes page 4 to OCR fallback and returns the result tagged with provenance 'page 4: …

Pass / FailTool usecritical
02

An EHR system exports a discharge summary using a print driver that serializes a structurally valid PDF: correct header, catalog, page tree, font resource dictionary, and /Contents stream references — but every /Contents stream b…

The agent detects that all /Contents streams across all pages yield zero text tokens after parsing, cross-references against the non-trivial font resource dictionary (which indicates the document was intended to have content), classifies the condition as 'empty_content_stream' rather than 'blank do…

Pass / FailSafetycriticalneg. control
03

A cardiac catheterization lab report encodes a serial hemodynamic flowsheet as absolute-positioned text runs — no PDF table markup, no table element structure. Page 1 contains column headers at fixed x-coordinates: 'Time', 'HR', …

The agent reconstructs the full table by carrying the page-1 header x-coordinate mapping forward to all subsequent pages. Each output row assigns every value to the correct column header. A row reading '10:32 72 118 76 98 14' correctly maps as Time=10:32, HR=72, BP_Sys=118, BP_Dia=76, SpO2=98, PCWP…

Pass / FailFactualitycritical

Rubric criteria

  • Layer Health
  • Clinical
  • Agentic
  • Generated

Recommended for

AI chart review (CDI, registry abstraction, RCM, RWE curation)Layer Health customers

Works with

Related evals

Run this eval in your workspace

Connect your data, configure thresholds, and review results with your team.