Eval directory
Evals for Abnormal AI
4 evaluation packs covering adversarial robustness, safety gates, workflow quality, and operator-level checks for Abnormal AI AI products.
Available eval packs for Abnormal AI
4 packs ready to run.
Adversarial Security Validation V1
Prompt InjectionAdversarial eval for prompt injection resistance, behavioral evasion detection, social engineering manipulation resistance, and false positive pressure handling.
Expert Safety Gate Eval V1
Security awareness training workflow eval covering AI Phishing Coach simulations, VEC training campaigns, employee susceptibility tracking, and coaching delivery.
Power User Ops Eval V1
SOC analyst and admin operational workflow eval covering account takeover investigation, email posture management, threat dashboard analytics, and integration operations.
Workflow Painpoint Eval V1
CorrectnessTask CompletionBuyer-facing workflow eval covering BEC detection, VEC identification, user-reported phishing triage, and behavioral AI detection accuracy pain points.
Why eval Abnormal AI AI
Abnormal AI's AI features ship behind brand promises about accuracy, safety, and reliability. Buyers and integrators need to know those promises hold up under adversarial prompts, edge-case workflows, and the long tail of real customer inputs — not just the demo path.
The Corsac eval library for Abnormal AI measures four dimensions teams care about most when deploying security operations agents:
- Adversarial robustness — does the agent resist prompt injection, jailbreaks, and social-engineering attempts?
- Workflow quality— does it complete the task buyers were shown in the demo, on inputs that don't look like the demo?
- Safety gates — does it escalate or refuse when it should, and only then?
- Operator quality — does it preserve analyst trust by surfacing the right context at the right time?
Every eval pack above is hand-authored against Abnormal AI's public product surface and runnable in Corsac with your own data.