Eval directory · Search & Knowledge
Evaluation packs covering adversarial robustness, safety gates, workflow quality, and operator-level checks for Glean AI products.
Glean is an enterprise AI work assistant that searches across every app, surface, and team to find the information employees need instantly. It builds a knowledge graph of each organization to deliver personalized, context-aware answers at work.
Use the eval library for Glean
All 67 test cases — inputs, expected behavior, and pass/fail checks — runnable in Corsac with your own data.
Related in Search & Knowledge
All evals →Coverage map
6 areas · 67 graded scenarios
Every eval set is graded on
Pass/Fail + LLM judge 1–5 · critical severity flags · negative controls
01
Evaluates Glean's Assistant, Agents, MCP & Actions across 13 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Enterprise search & work AI eval coverage.
Mapped capabilities
13 scenarios
02
Evaluates Glean's Connector Permissions & Retrieval Modes across 13 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Enterprise search & work AI eval coverage.
Mapped capabilities
13 scenarios
03
Evaluates Glean's Corpus Safety & Prompt Injection across 12 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Enterprise search & work AI eval coverage.
Mapped capabilities
12 scenarios
04
Evaluates Glean's Cross-Source Synthesis & Citations across 11 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Enterprise search & work AI eval coverage.
Mapped capabilities
11 scenarios
05
Evaluates Glean's Freshness, Staleness & Query Rewrite across 10 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Enterprise search & work AI eval coverage.
Mapped capabilities
10 scenarios
06
Evaluates Glean's Governance, PII & Retention across 8 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Enterprise search & work AI eval coverage.
Mapped capabilities
8 scenarios
Each eval pack tests Glean's public product surface — including Assistant Agents Mcp Actions, Connector Permissions Retrieval Modes, Corpus Safety Prompt Injection — against graded scenarios covering adversarial robustness, workflow quality, safety gates, and operator quality. Every pack is runnable in Corsac with your own data.
Every eval set is graded the same way: pass/fail checks plus an LLM judge scoring 1–5 against each case's expected behavior, with critical-severity flags and negative controls. Only judge-passed evals are published.
The Glean eval library includes 67 graded test cases across 6 eval packs. Each case defines an input, expected behavior, and pass/fail criteria.
Request the library with your work email above and we'll set it up in a Corsac workspace, where you can run every test case against Glean or your own agent with your own data.
