
Ssc Parser Regression V1
Configuration Importer (parser) · StaffScheduleCare
Regression eval library for SSC's deterministic XLSX intake-form parser. Each fixture is a small synthetic workbook designed to lock in one specific parser code path tied to a known/resolved bug — when the parser regresses on that path, the fixture name tells you which fix broke. This dataset contains the 11 synthetic regression fixtures only. SSC's local CI runs an extended dataset that also includes their 5 real client fixtures (kept in the SSC repo for data-isolation reasons). EXECUTION MODEL — EXTERNAL ONLY (until Phase 2): This spec is designed to run via the SSC SDK in the SSC repo's CI, which invokes the TypeScript parser locally and reports per-example results to Corsac. The dataset shape ({input: {fixture_path}, expected: {data, errors, warnings}}) reflects that workflow — it does NOT match the doc_agent runner's input/output contract (input.document/input.instruction → {result: ...}). Triggering "Run" from the Corsac UI will currently fail with structural mismatches; that's expected. Phase 2 work fixes this two ways: (a) adds a 'parser_regression' category whose runner skips server-side execution, and (b) ships the external-run endpoint that accepts pushed results from SSC's CI. Tracked in issues/phase-2-ssc-pilot-readiness.md (2-09, 2-17) and issues/phase-1.5b-autogen-hardening.md.
Sample tests· showing 3 of 11
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | fixture_path: eval_datasets/ssc/fixtures/synthetic/01_wage_grid_max_rate_… · fixture_size_bytes: 24902 | {"data":{"departments":[{"code":"NURS","description":"Nursing"}],"labourClasses":[{"code":"RN","description":"Registered Nurse","rateMethod":"worked_rate","wageGrid":[{"levelNumbe… | Pass / Fail |
| 02 | fixture_path: eval_datasets/ssc/fixtures/synthetic/02_duplicate_day_codes… · fixture_size_bytes: 22961 | warnings: [object Object] | Pass / Fail |
| 03 | fixture_path: eval_datasets/ssc/fixtures/synthetic/03_blank_punches_defau… · fixture_size_bytes: 22510 | warnings: [object Object] | Pass / Fail |
Rubric criteria
- Ssc
- Parser
- Regression
- Deterministic
- Library
- External-only
Recommended for
Works with
Related evals
Eval Factory Imported Suite
Imported eval-factory suite for 11x.
View Document AgentsMeeting Recap and Actions
Turn meeting notes and partial transcripts into crisp recaps with owners, deadlines, and next steps.
View Document AgentsMeet Recap Copilot
Eval for meeting recap quality, action-item extraction, and ownership tracking from live or recorded meeting context.
ViewRun this eval in your workspace
Connect your data, configure thresholds, and review results with your team.