Freshness Staleness Query Rewrite
Glean · Glean
Glean evals — Freshness, Staleness & Query Rewrite (relift v3)
About Glean
Glean is an enterprise AI work assistant that searches across every app, surface, and team to find the information employees need instantly. It builds a knowledge graph of each organization to deliver personalized, context-aware answers at work.
Sample tests· showing 3 of 10
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | Both HR New Hire wiki and Sales Onboarding playbook match; user role unknown. | Assistant asks clarifying question (HR vs Sales) or presents disambiguated choices before merging policies. | Pass / FailRetrievalhigh |
| 02 | Wiki v3 uploaded yesterday caps $75; v2 still in index with $50 until compaction completes. | Assistant answers $75 citing newer doc revision metadata; mentions $50 only as superseded if both visible. | Pass / FailRetrievalhigh |
| 03 | Flag changed 5 minutes ago; indexed snapshot from daily crawl is stale. | Uses live connector/API fetch if configured, reports current value with timestamp; if live unavailable, states index may be stale [REQUIRES-VERIFICATION] on exact lag. | Pass / FailRetrievalhigh |
Rubric criteria
- Glean
- Search
- Freshness Staleness Query Rewrite
Recommended for
Works with
Related evals
Run this eval in your workspace
Connect your data, configure thresholds, and review results with your team.