Eval directory
Evals for WorkOS
6 evaluation packs covering adversarial robustness, safety gates, workflow quality, and operator-level checks for WorkOS AI products.
About WorkOS
WorkOS provides enterprise-readiness APIs — SAML/OIDC SSO, Directory Sync (SCIM), MFA, Audit Logs, and an Admin Portal — that let applications add enterprise authentication and provisioning in days instead of months.
How complete this published benchmark library is across datasets, metrics, rubrics, use-case maps, and pack context. This is library coverage, not an agent performance score.
Test datasets
6/6 packs
Scoring metrics
0/6 packs
Judge rubrics
6/6 packs
Use-case maps
0/6 packs
Pack context
6/6 packs
Available eval packs for WorkOS
6 packs ready to run.
Admin Portal Domains Orgs
Evaluates WorkOS' Admin Portal, Domains & Organizations across 12 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Enterprise Auth & Provisioning eval coverage.
Audit Logs Event Integrity
Evaluates WorkOS' Audit Logs & Event Integrity across 12 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Enterprise Auth & Provisioning eval coverage.
Mfa Factor Recovery
Evaluates WorkOS' MFA & Factor Recovery across 12 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Enterprise Auth & Provisioning eval coverage.
Oidc Oauth Session Tokens
Evaluates WorkOS' OIDC, OAuth & Session Tokens across 13 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Enterprise Auth & Provisioning eval coverage.
Saml Sso Assertion Security
Evaluates WorkOS' SAML SSO & Assertion Security across 11 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Enterprise Auth & Provisioning eval coverage.
Scim Directory Sync
Evaluates WorkOS' SCIM Directory Sync & Deprovisioning across 13 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Enterprise Auth & Provisioning eval coverage.
Why eval WorkOS AI
WorkOS's AI features ship behind brand promises about accuracy, safety, and reliability. Buyers and integrators need to know those promises hold up under adversarial prompts, edge-case workflows, and the long tail of real customer inputs — not just the demo path.
The Corsac eval library for WorkOS measures four dimensions teams care about most when deploying security operations agents:
- Adversarial robustness — does the agent resist prompt injection, jailbreaks, and social-engineering attempts?
- Workflow quality— does it complete the task buyers were shown in the demo, on inputs that don't look like the demo?
- Safety gates — does it escalate or refuse when it should, and only then?
- Operator quality — does it preserve analyst trust by surfacing the right context at the right time?
Every eval pack above is hand-authored against WorkOS's public product surface and runnable in Corsac with your own data.