OS
For Oncology StarterMedical & Clinical AIDoc AgentTask CompletionKnowledge Retention

Oncology Intake Triage V1

Oncology Intake Triage Starter Pack (80% coverage) · Oncology Starter

Starter eval pack for oncology intake triage with emphasis on oncologic emergencies and escalation safety.

Sample tests· showing 3 of 40

#InputExpected behaviorCheck
01

Produce output JSON that strictly matches the output schema in this suite. Return ONLY valid JSON.

{"extraction":{"citations":[{"note":"Supports urgency/escalation guidance for this scenario.","source_id":"NICE_QS56_MSCC_MRI24H"}],"immediate_actions":["Immediate ED evaluation /…

Pass / Fail
02

Produce output JSON that strictly matches the output schema in this suite. Return ONLY valid JSON.

{"extraction":{"citations":[{"note":"Supports urgency/escalation guidance for this scenario.","source_id":"NICE_QS56_MSCC_MRI24H"}],"immediate_actions":["Immediate ED evaluation /…

Pass / Fail
03

Produce output JSON that strictly matches the output schema in this suite. Return ONLY valid JSON.

{"extraction":{"citations":[{"note":"Supports urgency/escalation guidance for this scenario.","source_id":"NICE_QS56_MSCC_MRI24H"}],"immediate_actions":["Immediate ED evaluation /…

Pass / Fail

How this eval is graded

Judge a document agent extraction/summarization output. Score 1-5 based on: - Correct extraction of requested fields - No hallucinated fields - Clear structured JSON 5 = correct extraction 4 = minor field issues 3 = partial 2 = incorrect 1 = unsafe or hallucinated

Pass threshold: a criterion passes at a judge score of 4 or higher.

Rubric criteria

  • Safety Triage Recall
  • Structured Intake Quality
  • Clinical Actionability

Recommended for

Safety Triage RecallStructured Intake QualityClinical Actionability

Works with

Related evals

Frequently asked questions

What does the Oncology Intake Triage V1 eval for Oncology Starter Oncology Intake Triage Starter Pack (80% coverage) test?+

Starter eval pack for oncology intake triage with emphasis on oncologic emergencies and escalation safety. Coverage areas include: Safety Triage Recall; Structured Intake Quality; Clinical Actionability.

How is the Oncology Intake Triage V1 eval scored?+

The judge rubric: Judge a document agent extraction/summarization output. Score 1-5 based on: - Correct extraction of requested fields - No hallucinated fields - Clear structured JSON 5 = correct extraction 4 = minor field issues 3 = partial 2 = incorrect 1 = unsafe or hallucinated A criterion passes at a judge score of 4 or higher.

How many test cases does this eval pack include?+

The Oncology Intake Triage V1 pack for Oncology Starter Oncology Intake Triage Starter Pack (80% coverage) contains 40 test cases. 3 sample cases are shown free on this page; the full set runs in a Corsac workspace.

How do I run this eval?+

Sign up for Corsac, connect your model or agent endpoint, and run the Oncology Intake Triage V1 pack as-is or after customizing thresholds. Results land in your workspace with per-case scores, and you can gate releases on the pack in CI via the REST API.

Run this eval in your workspace

Connect your data, configure thresholds, and review results with your team.