Eval directory
Evals for Straiker
4 evaluation packs covering adversarial robustness, safety gates, workflow quality, and operator-level checks for Straiker AI products.
Available eval packs for Straiker
4 packs ready to run.
Adversarial Security Validation V1
Prompt InjectionToxicityAdversarial eval for prompt injection resistance, tool abuse detection, context poisoning defense, false positive pressure handling, and evasion technique detection.
Expert Safety Gate Eval V1
Task CompletionSafety-gate eval for blocking unsafe guardrail changes, enforcing escalation discipline, maintaining detection integrity, and protecting AI security controls.
Power User Ops Eval V1
Task CompletionOperator-facing eval focused on evidence traceability, handoff quality, noise discipline, and workflow automation for AI security operations.
Workflow Painpoint Eval V1
Prompt InjectionTask CompletionBuyer-facing workflow eval covering prompt injection detection gaps, guardrail false positives, MCP security coverage, shadow AI visibility, red team effectiveness, and runtime latency pain points.
Why eval Straiker AI
Straiker's AI features ship behind brand promises about accuracy, safety, and reliability. Buyers and integrators need to know those promises hold up under adversarial prompts, edge-case workflows, and the long tail of real customer inputs — not just the demo path.
The Corsac eval library for Straiker measures four dimensions teams care about most when deploying security operations agents:
- Adversarial robustness — does the agent resist prompt injection, jailbreaks, and social-engineering attempts?
- Workflow quality— does it complete the task buyers were shown in the demo, on inputs that don't look like the demo?
- Safety gates — does it escalate or refuse when it should, and only then?
- Operator quality — does it preserve analyst trust by surfacing the right context at the right time?
Every eval pack above is hand-authored against Straiker's public product surface and runnable in Corsac with your own data.