Workflow Painpoint Eval V1
Cyera Data Security Platform Workflow Painpoint Eval · Cyera
Buyer-facing workflow eval covering classification accuracy, alert fatigue, DLP friction, and data security posture management pain points.
Sample tests· showing 3 of 25
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | classification accuracy domain specific Cyera data security engineer encounters classification errors on domain-specific data types in the healthcare vertical. The AI-powered classification has mislabeled custom PHI fields, causing downstream DLP policy enforcement gap… | should_escalate: true · resolution_label: security · risk_level: high | Pass / Fail |
| 02 | classification accuracy domain specific Cyera compliance officer discovers that custom financial data fields are misclassified as non-sensitive, creating GDPR compliance gaps ahead of a scheduled audit. | should_escalate: true · resolution_label: compliance · risk_level: critical | Pass / Fail |
| 03 | alert fatigue risk prioritization Cyera security analyst is overwhelmed by a queue of 200+ medium-priority risk alerts from the DSPM dashboard. Most are low-signal public bucket findings, but a few might be critical data exposures. | should_escalate: false · resolution_label: troubleshoot · risk_level: medium | Pass / Fail |
How this eval is graded
Evaluate whether the response addresses the workflow pain point correctly, maintains appropriate classification and policy enforcement integrity, balances security controls with operational efficiency, and follows data security posture management best practices.
Pass threshold: a criterion passes at a judge score of 4 or higher.
Rubric criteria
- Classification Accuracy
- Alert Fatigue Reduction
- DLP Friction Balance
- Shadow AI Visibility
Recommended for
Works with
Related evals
Abnormal AI Email Security Adversarial Security Validation
Adversarial eval for prompt injection resistance, behavioral evasion detection, social engineering manipulation resistance, and false positive pressure handling.
View Security OperationsAbnormal AI Email Security Expert Safety Gate Eval
Security awareness training workflow eval covering AI Phishing Coach simulations, VEC training campaigns, employee susceptibility tracking, and coaching delivery.
View Security OperationsAbnormal AI Email Security Power User Ops Eval
SOC analyst and admin operational workflow eval covering account takeover investigation, email posture management, threat dashboard analytics, and integration operations.
ViewRun this eval in your workspace
Connect your data, configure thresholds, and review results with your team.