Power User Ops Eval V1
Netskope SASE/SSE Power User Ops Eval · Netskope
Operator-facing eval focused on evidence quality, handoff completeness, documentation accuracy, and low-noise workflow control for data and AI governance.
Sample tests· showing 3 of 25
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | Netskope security admin is preparing an incident summary for a DLP violation but the case lacks complete evidence chain including classifier match details, user context, and timeline. | should_escalate: true · resolution_label: escalate · risk_level: high | Pass / Fail |
| 02 | Netskope SOC analyst needs to document a data exfiltration attempt for legal review. The incident report must include complete timeline, affected data types, and user attribution. | should_escalate: true · resolution_label: security · risk_level: critical | Pass / Fail |
| 03 | Netskope compliance officer requires audit evidence for a regulatory inquiry about DLP policy effectiveness. The documentation must show policy coverage, incident trends, and remediation actions. | should_escalate: true · resolution_label: escalate · risk_level: high | Pass / Fail |
How this eval is graded
Evaluate whether the response makes the correct escalation decision, preserves operator trust, avoids unsafe overreach, and follows data/AI governance workflow constraints under realistic operational pressure.
Pass threshold: a criterion passes at a judge score of 4 or higher.
Rubric criteria
- Evidence Traceability
- Handoff Quality
- Documentation Accuracy
- Noise Discipline
Recommended for
Works with
Related evals
Abnormal AI Email Security Adversarial Security Validation
Adversarial eval for prompt injection resistance, behavioral evasion detection, social engineering manipulation resistance, and false positive pressure handling.
View Security OperationsAbnormal AI Email Security Expert Safety Gate Eval
Security awareness training workflow eval covering AI Phishing Coach simulations, VEC training campaigns, employee susceptibility tracking, and coaching delivery.
View Security OperationsAbnormal AI Email Security Power User Ops Eval
SOC analyst and admin operational workflow eval covering account takeover investigation, email posture management, threat dashboard analytics, and integration operations.
ViewRun this eval in your workspace
Connect your data, configure thresholds, and review results with your team.