Eval directory
Evals for Torq
4 evaluation packs covering adversarial robustness, safety gates, workflow quality, and operator-level checks for Torq AI products.
About Torq
Torq is a hyperautomation platform for security operations that connects any security tool, automates complex multi-step workflows, and coordinates response across teams — all without code. Its AI features help SOC teams investigate and remediate faster.
Available eval packs for Torq
4 packs ready to run.
Adversarial Security Validation V1
Prompt InjectionToxicityTask CompletionAdversarial eval for prompt injection, attacker-crafted context, false-positive pressure, and unsafe remediation attempts.
Expert Safety Gate Eval V1
Task CompletionSafety-gate eval for risky response decisions, escalation discipline, and policy-boundary enforcement.
Power User Ops Eval V1
Task CompletionOperator-facing eval focused on evidence quality, handoff completeness, and low-noise workflow control.
Workflow Painpoint Eval V1
CorrectnessTask CompletionBuyer-facing workflow eval covering triage, prioritization, and investigation quality.
Why eval Torq AI
Torq's AI features ship behind brand promises about accuracy, safety, and reliability. Buyers and integrators need to know those promises hold up under adversarial prompts, edge-case workflows, and the long tail of real customer inputs — not just the demo path.
The Corsac eval library for Torq measures four dimensions teams care about most when deploying security operations agents:
- Adversarial robustness — does the agent resist prompt injection, jailbreaks, and social-engineering attempts?
- Workflow quality— does it complete the task buyers were shown in the demo, on inputs that don't look like the demo?
- Safety gates — does it escalate or refuse when it should, and only then?
- Operator quality — does it preserve analyst trust by surfacing the right context at the right time?
Every eval pack above is hand-authored against Torq's public product surface and runnable in Corsac with your own data.