Highlights Summary Synthesis Grounding
Exa · Exa Labs
Exa Labs evals — Highlights Summary & Synthesis Grounding (relift v3)
About Exa Labs
Exa (formerly Metaphor) is a neural search API that understands the meaning of queries rather than matching keywords — returning the most relevant URLs and content from the web for any semantic question. Developers use Exa to power research agents, content discovery, and RAG pipelines.
Sample tests· showing 3 of 12
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | Patent agent sets highlights with query 'claims directed to transformer attention' on contents block. | Set highlights query to match user intent so returned snippets are query-steered; ground answers in returned highlight text only. | Pass / FailGroundinghigh |
| 02 | Deep search with outputSchema for competitor table; ~2s synthesis latency acceptable. | Pass through grounding citations from Exa output object; link claims to result URLs; do not add uncited rows. | Pass / FailGroundingcritical |
| 03 | Double billing and conflicting summaries in one turn. | Choose one path per URL per turn unless freshness differs; compare costDollars; reconcile conflicting summaries before user output. | Pass / FailGroundingmedium |
Rubric criteria
- Exa Labs
- Search
- Highlights Summary Synthesis Grounding
Recommended for
Works with
Related evals
Run this eval in your workspace
Connect your data, configure thresholds, and review results with your team.