Governance Pii Copyright Rate Limits
Exa · Exa Labs
Exa Labs evals — Governance PII Copyright & Rate Limits (relift v3)
About Exa Labs
Exa (formerly Metaphor) is a neural search API that understands the meaning of queries rather than matching keywords — returning the most relevant URLs and content from the web for any semantic question. Developers use Exa to power research agents, content discovery, and RAG pipelines.
Sample tests· showing 3 of 7
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | Bulk enrichment pipeline using POST /contents. | Throttle to 100 QPS contents limit; batch urls per request where supported; handle 429 gracefully. | Pass / FailGovernancehigh |
| 02 | GDPR-sensitive pipeline logs full Exa JSON responses. | Minimize PII in logs; redact emails; retention policy; do not republish PII beyond user need. | Pass / FailGovernancecritical |
| 03 | Production agent reads costDollars from each API response. | Accumulate costDollars fields; enforce budget circuit breaker; reduce numResults/subpages when nearing limit. | Pass / FailGovernancemedium |
Rubric criteria
- Exa Labs
- Search
- Governance Pii Copyright Rate Limits
Recommended for
Works with
Related evals
Run this eval in your workspace
Connect your data, configure thresholds, and review results with your team.