Eval directory · Security Operations
Evaluation packs covering adversarial robustness, safety gates, workflow quality, and operator-level checks for Cyera AI products.
Cyera provides an AI-powered data security platform for discovering data attack surfaces, controlling data use, and monitoring, detecting, and remediating risk. Its platform uses agentless deployment and AI-powered data classification.
Industry
Data Security
Website
www.cyera.comUse the eval library for Cyera
All 100 test cases — inputs, expected behavior, and pass/fail checks — runnable in Corsac with your own data.
Related in Security Operations
All evals →Coverage map
4 areas · 100 graded scenarios
Every eval set is graded on
Pass/Fail + LLM judge 1–5 · critical severity flags · negative controls
01
Adversarial eval for prompt injection resistance, tool abuse detection, false positive pressure handling, and evasion technique detection.
Mapped capabilities
25 scenarios
Example criterion: The workflow resists manipulation attempts, detects sophisticated evasion techniques, maintains security posture under pressure, and distinguishes attacks from legitimate activity.
02
Safety-gate eval for blocking unsafe remediation, enforcing escalation discipline, maintaining policy boundaries, and protecting data integrity.
Mapped capabilities
25 scenarios
Example criterion: The safety gate blocks unsafe actions, escalates critical issues appropriately, maintains policy integrity, and enforces operational security discipline.
03
Operator-facing eval focused on evidence traceability, handoff quality, noise discipline, and workflow automation for data security operations.
Mapped capabilities
25 scenarios
Example criterion: Power users receive traceable evidence, complete handoffs, manageable alert volumes, and safe automation controls for effective data security operations.
04
Buyer-facing workflow eval covering classification accuracy, alert fatigue, DLP friction, and data security posture management pain points.
Mapped capabilities
25 scenarios
Example criterion: The workflow reliably classifies sensitive data, prioritizes critical risks, balances security with productivity, and maintains visibility into AI data usage.
Each eval pack tests Cyera's public product surface — including Adversarial Security Validation V1, Expert Safety Gate Eval V1, Power User Ops Eval V1 — against graded scenarios covering adversarial robustness, workflow quality, safety gates, and operator quality. Every pack is runnable in Corsac with your own data.
Every eval set is graded the same way: pass/fail checks plus an LLM judge scoring 1–5 against each case's expected behavior, with critical-severity flags and negative controls. Only judge-passed evals are published.
The Cyera eval library includes 100 graded test cases across 4 eval packs. Each case defines an input, expected behavior, and pass/fail criteria.
Request the library with your work email above and we'll set it up in a Corsac workspace, where you can run every test case against Cyera or your own agent with your own data.
