Eval directory · Customer Support
Evaluation packs covering adversarial robustness, safety gates, workflow quality, and operator-level checks for Zendesk AI products.
Zendesk is a customer service platform that helps businesses build better customer relationships. Its AI-powered products handle billions of support interactions across email, chat, voice, and messaging, giving agents the context they need to resolve issues faster.
Use the eval library for Zendesk
All 649 test cases — inputs, expected behavior, and pass/fail checks — runnable in Corsac with your own data.
Related in Customer Support
All evals →Coverage map
10 areas · 649 graded scenarios
Every eval set is graded on
Pass/Fail + LLM judge 1–5 · critical severity flags · negative controls
01
Zendesk admin workflow eval focused on automation reliability, trigger safety, and configuration clarity.
Mapped capabilities
100 scenarios
Example criterion: Zendesk admin workflows run reliably with safe automation behavior and strong operational guardrails.
02
Zendesk support agent daily workflow eval focused on reply quality, queue noise, and resolution safety.
Mapped capabilities
100 scenarios
Example criterion: Zendesk maintains high-quality daily support execution with stable response quality and safe queue handling.
03
Evaluates Zendesk's Expert Safety Gate Eval V2 High Conf — safety gate enforcement, high-risk scenario handling, and release readiness assurance — across 36 test cases graded case by case by an LLM judge.
Mapped capabilities
36 scenarios
Example criterion: Zendesk enforces expert safety gates reliably and prevents unsafe outputs in production-critical scenarios.
04
Wave 2 production eval for Zendesk focused on incident escalation quality.
Mapped capabilities
16 scenarios
Example criterion: Zendesk delivers high-quality incident escalations with accurate triggers, complete context, and fast mitigation guidance.
05
Zendesk support lead eval focused on high-volume queue command, escalation discipline, and response stability.
Mapped capabilities
100 scenarios
Example criterion: Zendesk supports incident command with accurate prioritization, disciplined escalation, and stable response coordination.
06
Zendesk support manager eval focused on quality oversight, reporting clarity, and coaching outcomes.
Mapped capabilities
100 scenarios
Example criterion: Zendesk provides manager-grade quality coaching signals that are accurate, actionable, and operationally useful.
07
Evaluates Zendesk's Power User Ops Eval V2 High Conf — advanced workflow reliability, safety control integrity, and operational consistency — across 40 test cases graded case by case by an LLM judge.
Mapped capabilities
40 scenarios
Example criterion: Zendesk supports power users with reliable operations, strong safety controls, and consistent production-quality execution.
08
Operational response/safety eval for Zendesk covering support resolution safety.
Mapped capabilities
12 scenarios
Example criterion: Zendesk delivers safe, high-quality support resolutions with correct escalation behavior and consistent policy alignment.
09
Evaluates Zendesk's Workflow Painpoint Eval V2 High Conf — workflow friction detection, severity prioritization, and actionable fix design — across 45 test cases graded case by case by an LLM judge.
Mapped capabilities
45 scenarios
Example criterion: Zendesk consistently surfaces true workflow painpoints, prioritizes them correctly, and provides remediation steps teams can act on.
10
Zendesk ingest eval pack, persona-balanced and source-traceable per test row.
Mapped capabilities
100 scenarios
Example criterion: Zendesk detects ingest painpoints with traceable evidence and prioritized fixes that improve downstream quality.
Each eval pack tests Zendesk's public product surface — including Admin Workflow Safety V1, Agent Daily Work V1, Expert Safety Gate Eval V2 High Conf — against graded scenarios covering adversarial robustness, workflow quality, safety gates, and operator quality. Every pack is runnable in Corsac with your own data.
Every eval set is graded the same way: pass/fail checks plus an LLM judge scoring 1–5 against each case's expected behavior, with critical-severity flags and negative controls. Only judge-passed evals are published.
The Zendesk eval library includes 649 graded test cases across 10 eval packs. Each case defines an input, expected behavior, and pass/fail criteria.
Request the library with your work email above and we'll set it up in a Corsac workspace, where you can run every test case against Zendesk or your own agent with your own data.
