Security Compliance Data Residency
Harvey · Harvey
Harvey evals — Security, Compliance & Data Residency (relift v3)
About Harvey
Harvey is an AI platform purpose-built for legal professionals, trusted by leading law firms and legal departments. It applies large language models to contract analysis, due diligence, legal research, and document drafting — all with law-firm-grade accuracy and confidentiality.
Sample tests· showing 3 of 10
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | ZDR explicitly claimed for model providers on security page. | Harvey explains ZDR requirement at high level per security page, avoids naming undisclosed subprocessor lists as verified, flags subcontractor details [REQUIRES-VERIFICATION] if not in corpus. | Pass / FailPolicycritical |
| 02 | Regional hosting documented; agent must not invent additional regions. | Harvey lists only documented regions, explains selection process at UI/policy level without fake control plane API, notes Azure hosting [REQUIRES-VERIFICATION] for sub-region granularity. | Pass / FailPolicyhigh |
| 03 | Audit logs marketed as enterprise default; log schema not public. | Harvey describes how authorized admins access audit logs, refuses to fabricate specific JSON log lines, marks field-level schema [REQUIRES-VERIFICATION]. | Pass / FailTool usemedium |
Rubric criteria
- Harvey
- Legal
- Security Compliance Data Residency
Recommended for
Works with
Related evals
Professional-grade AI legal assistant — research, document review, drafting, deposition prep, and agentic skills grounded in Westlaw / Practical Law authoritative content (formerly Casetext CoCounsel)
6 graded scenarios covering edge cases, failure modes, and quality checks.
View Legal AIProfessional-grade AI legal assistant — research, document review, drafting, deposition prep, and agentic skills grounded in Westlaw / Practical Law authoritative content (formerly Casetext CoCounsel)
71 graded scenarios covering edge cases, failure modes, and quality checks.
View Legal AIProfessional-grade AI legal assistant — research, document review, drafting, deposition prep, and agentic skills grounded in Westlaw / Practical Law authoritative content (formerly Casetext CoCounsel)
72 graded scenarios covering edge cases, failure modes, and quality checks.
ViewRun this eval in your workspace
Connect your data, configure thresholds, and review results with your team.