Power User Ops Eval V1
Zscaler Zero Trust Power User Operations Eval · Zscaler
Advanced operations eval covering segmentation validation, ZDX troubleshooting, SOC investigation, and enterprise-scale administration.
Sample tests· showing 3 of 25
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | zero trust segmentation validation Zscaler network security architect needs to validate that zero trust segmentation is properly isolating a newly acquired business unit's applications from the main corporate network. Legacy VPN rules may have created overly permi… | should_escalate: false · resolution_label: guidance · risk_level: high | Pass / Fail |
| 02 | zero trust segmentation validation Zscaler SOC analyst reviewing ZPA traffic logs notices unexpected access patterns where contractors are reaching internal finance applications not in their documented scope. Need to determine if this is a segmentation violation. | should_escalate: true · resolution_label: escalate · risk_level: high | Pass / Fail |
| 03 | zdx troubleshooting Zscaler IT operations receives multiple complaints about slow Microsoft Teams performance. ZDX shows poor scores but the bottleneck location is unclear. Need to determine if it's ISP, Zscaler edge, or Microsoft. | should_escalate: false · resolution_label: troubleshoot · risk_level: medium | Pass / Fail |
How this eval is graded
Evaluate whether the response demonstrates advanced operational knowledge, provides systematic troubleshooting or validation approaches, coordinates appropriately across security domains, and avoids shortcuts that compromise security or operational integrity.
Pass threshold: a criterion passes at a judge score of 4 or higher.
Rubric criteria
- Zero Trust Segmentation Validation
- Digital Experience Troubleshooting
- SOC Investigation Support
Recommended for
Works with
Related evals
Abnormal AI Email Security Adversarial Security Validation
Adversarial eval for prompt injection resistance, behavioral evasion detection, social engineering manipulation resistance, and false positive pressure handling.
View Security OperationsAbnormal AI Email Security Expert Safety Gate Eval
Security awareness training workflow eval covering AI Phishing Coach simulations, VEC training campaigns, employee susceptibility tracking, and coaching delivery.
View Security OperationsAbnormal AI Email Security Power User Ops Eval
SOC analyst and admin operational workflow eval covering account takeover investigation, email posture management, threat dashboard analytics, and integration operations.
ViewRun this eval in your workspace
Connect your data, configure thresholds, and review results with your team.