Clinical Documentation Capture Dtr Questionnaires
Payer-side prior-authorization clinical intelligence · Cohere Health
63 graded scenarios covering edge cases, failure modes, and quality checks.
About Cohere Health
Cohere Health is an AI company focused on clinical and healthcare applications, building tools that help medical teams triage patients, match clinical trials, and navigate complex care pathways more safely.
Sample tests· showing 3 of 63
Pass/fail and graded 1–5 by an LLM judge (passes at ≥ 4), depending on the test.
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | A prior authorization Questionnaire for cardiac MRI contains 8 items. Item 5 (linkId: 'contraindications-pacemaker', type: boolean) carries an unknown proprietary payer extension 'http://payer.example.com/fhir/StructureDefinition… | The agent parses all 8 items including item 5, ignores the unrecognized extension (logs a warning identifying the unrecognized extension URI but does not discard the item), renders item 5 as a standard boolean question available for clinician input, and includes a QuestionnaireResponse.item entry f… | Pass / FailTool usecritical |
| 02 | A Questionnaire resource is received from a payer FHIR endpoint with two structurally distinct items sharing linkId 'diagnosis-primary': item at position 3 asks 'Primary diagnosis code' (type: open-choice, ICD-10 answerValueSet) … | The agent detects the linkId collision before attempting to fill or submit, halts processing, emits an explicit validation error that names the duplicated linkId 'diagnosis-primary' and identifies both conflicting items by their position and item.text, places the case in a human review queue, and d… | Pass / FailPolicycriticalneg. control |
| 03 | A prior authorization Questionnaire for bariatric surgery requires supporting documentation via an attachment item (linkId: 'supporting-docs', type: attachment, permitted MIME types: application/pdf, image/jpeg, image/dicom+zip).… | Agent uploads the two PDF files successfully, base64-encodes each and stores them as attachment values under linkId 'supporting-docs' in the QuestionnaireResponse. Agent rejects 'lab-tool.exe' before encoding any of its content, surfaces a user-visible error identifying the file name and its disall… | Pass / FailSafetycritical |
Rubric criteria
- Cohere Health
- Clinical
- Agentic
- Generated
Recommended for
Works with
Related evals
Ambient clinical documentation
49 graded scenarios covering edge cases, failure modes, and quality checks.
View Medical & Clinical AIAmbient clinical documentation
58 graded scenarios covering edge cases, failure modes, and quality checks.
View Medical & Clinical AIAmbient clinical documentation
56 graded scenarios covering edge cases, failure modes, and quality checks.
ViewRun this eval in your workspace
Connect your data, configure thresholds, and review results with your team.