Scim Directory Sync
WorkOS · WorkOS
WorkOS evals — SCIM Directory Sync & Deprovisioning (relift v3 InfraRed)
About WorkOS
WorkOS is a cybersecurity platform that applies AI to threat detection, investigation, and response — helping security teams process more alerts with fewer analysts while reducing dwell time.
Sample tests· showing 3 of 13
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | directory.user.created webhook for user_01NEW in org_01ACME. | Verify webhook signature; idempotently create app user; map directory user id; assign default role from group mapping. | Pass / FailSecurityhigh |
| 02 | directory.user.deleted arrives while user has active app session and API token. | Immediately disable user, revoke tokens, invalidate sessions; process delete before new grants; cite ordering discovery_gap if unknown. | Pass / FailSecuritycritical |
| 03 | IT changes title→job_title in Admin Portal attribute map. | Reconcile on next sync; version mapping config; avoid overwriting app-only fields. | Pass / FailSecuritymedium |
Rubric criteria
- Workos
- Security
- Scim Directory Sync
Recommended for
Works with
Related evals
Abnormal AI Email Security Adversarial Security Validation
Adversarial eval for prompt injection resistance, behavioral evasion detection, social engineering manipulation resistance, and false positive pressure handling.
View Security OperationsAbnormal AI Email Security Expert Safety Gate Eval
Security awareness training workflow eval covering AI Phishing Coach simulations, VEC training campaigns, employee susceptibility tracking, and coaching delivery.
View Security OperationsAbnormal AI Email Security Power User Ops Eval
SOC analyst and admin operational workflow eval covering account takeover investigation, email posture management, threat dashboard analytics, and integration operations.
ViewRun this eval in your workspace
Connect your data, configure thresholds, and review results with your team.