StaffScheduleCare
For StaffScheduleCareDocument Agents

Ssc Parser Regression V1

Configuration Importer (parser) · StaffScheduleCare

Regression eval library for SSC's deterministic XLSX intake-form parser. Each fixture is a small synthetic workbook designed to lock in one specific parser code path tied to a known/resolved bug — when the parser regresses on that path, the fixture name tells you which fix broke. This dataset contains the 11 synthetic regression fixtures only. SSC's local CI runs an extended dataset that also includes their 5 real client fixtures (kept in the SSC repo for data-isolation reasons). EXECUTION MODEL — EXTERNAL ONLY (until Phase 2): This spec is designed to run via the SSC SDK in the SSC repo's CI, which invokes the TypeScript parser locally and reports per-example results to Corsac. The dataset shape ({input: {fixture_path}, expected: {data, errors, warnings}}) reflects that workflow — it does NOT match the doc_agent runner's input/output contract (input.document/input.instruction → {result: ...}). Triggering "Run" from the Corsac UI will currently fail with structural mismatches; that's expected. Phase 2 work fixes this two ways: (a) adds a 'parser_regression' category whose runner skips server-side execution, and (b) ships the external-run endpoint that accepts pushed results from SSC's CI. Tracked in issues/phase-2-ssc-pilot-readiness.md (2-09, 2-17) and issues/phase-1.5b-autogen-hardening.md.

Sample tests· showing 3 of 11

#InputExpected behaviorCheck
01

fixture_path: eval_datasets/ssc/fixtures/synthetic/01_wage_grid_max_rate_… · fixture_size_bytes: 24902

{"data":{"departments":[{"code":"NURS","description":"Nursing"}],"labourClasses":[{"code":"RN","description":"Registered Nurse","rateMethod":"worked_rate","wageGrid":[{"levelNumbe…

Pass / Fail
02

fixture_path: eval_datasets/ssc/fixtures/synthetic/02_duplicate_day_codes… · fixture_size_bytes: 22961

warnings: [object Object]

Pass / Fail
03

fixture_path: eval_datasets/ssc/fixtures/synthetic/03_blank_punches_defau… · fixture_size_bytes: 22510

warnings: [object Object]

Pass / Fail

Rubric criteria

  • Ssc
  • Parser
  • Regression
  • Deterministic
  • Library
  • External-only

Recommended for

Configuration Importer (parser)StaffScheduleCare customers

Works with

Related evals

Run this eval in your workspace

Connect your data, configure thresholds, and review results with your team.