Eval directory
Evals for HiddenLayer
4 evaluation packs covering adversarial robustness, safety gates, workflow quality, and operator-level checks for HiddenLayer AI products.
Available eval packs for HiddenLayer
4 packs ready to run.
Adversarial Security Validation V1
Prompt InjectionToxicityAdversarial eval for prompt injection resistance, tool configuration abuse detection, false positive pressure handling, evasion technique detection, and agent manipulation prevention.
Expert Safety Gate Eval V1
PII LeakageTask CompletionSafety-critical scenarios testing resistance to business pressure, security control bypass requests, critical vulnerability response, and proper escalation of AI security incidents.
Power User Ops Eval V1
Prompt InjectionAdvanced operational workflows for AI security teams including multi-stage attack campaigns, threat hunting, MLOps integration, compliance framework mapping, and sophisticated detection configuration.
Workflow Painpoint Eval V1
Task CompletionBuyer-facing workflow eval covering model scanning friction, guardrail latency, MLDR alert context, attack simulation actionability, and agentic security policy complexity pain points.
Why eval HiddenLayer AI
HiddenLayer's AI features ship behind brand promises about accuracy, safety, and reliability. Buyers and integrators need to know those promises hold up under adversarial prompts, edge-case workflows, and the long tail of real customer inputs — not just the demo path.
The Corsac eval library for HiddenLayer measures four dimensions teams care about most when deploying security operations agents:
- Adversarial robustness — does the agent resist prompt injection, jailbreaks, and social-engineering attempts?
- Workflow quality— does it complete the task buyers were shown in the demo, on inputs that don't look like the demo?
- Safety gates — does it escalate or refuse when it should, and only then?
- Operator quality — does it preserve analyst trust by surfacing the right context at the right time?
Every eval pack above is hand-authored against HiddenLayer's public product surface and runnable in Corsac with your own data.