
Vlex Ask A Research Question Grounded Legal Q A
Global legal research platform with the Vincent AI agent — multi-step research, document analysis, drafting, and workflow building over a 1B+ document global law collection · vLex (Vincent AI)
58 graded scenarios covering edge cases, failure modes, and quality checks.
About vLex (Vincent AI)
vLex (Vincent AI) is an AI platform serving legal professionals, helping law firms and legal departments automate research, drafting, and review workflows with greater accuracy and speed than manual processes.
Sample tests· showing 3 of 58
Pass/fail and graded 1–5 by an LLM judge (passes at ≥ 4), depending on the test.
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | An agentic brief-drafting workflow submits a focused employment-law query explicitly scoped to Illinois state law. The agent is configured to extract all citations listed under 'controlling authority' from the memo and insert the… | The memo places only Illinois Supreme Court decisions, Illinois Appellate Court decisions, and Illinois Human Rights Act statutory text under any heading that conveys binding or controlling authority. Any Seventh Circuit or other federal decision is placed in a clearly labeled 'Persuasive Authority… | Pass / FailGroundingcritical |
| 02 | An associate asks Vincent for Illinois contract interpretation law and explicitly requests federal cases applying Illinois law be included. The corpus returns a mix of Illinois Supreme Court opinions and Seventh Circuit diversity… | The memo contains a 'Controlling Illinois Authority' section (Illinois Supreme Court and Appellate decisions, Illinois statutes) and a separate 'Persuasive Federal Authority' section (Seventh Circuit diversity opinions). Each Seventh Circuit citation carries a parenthetical identifying it as a dive… | Pass / FailGroundinghigh |
| 03 | An agentic due-diligence workflow generates a memo on the California implied covenant of good faith and fair dealing in commercial contracts between sophisticated parties. The agent is programmed to extract each citation from the… | Every citation string in the memo (case name, reporter volume, first page, pinpoint page) resolves via its hyperlink to a real vLex document. The document title matches the case name in the citation. The reporter volume and series match the citation string. The pinpoint page cited falls within the … | Pass / FailFactualitycritical |
Rubric criteria
- Vlex
- Legal
- Agentic
- Generated
Recommended for
Works with
Related evals
Professional-grade AI legal assistant — research, document review, drafting, deposition prep, and agentic skills grounded in Westlaw / Practical Law authoritative content (formerly Casetext CoCounsel)
6 graded scenarios covering edge cases, failure modes, and quality checks.
View Legal AIProfessional-grade AI legal assistant — research, document review, drafting, deposition prep, and agentic skills grounded in Westlaw / Practical Law authoritative content (formerly Casetext CoCounsel)
71 graded scenarios covering edge cases, failure modes, and quality checks.
View Legal AIProfessional-grade AI legal assistant — research, document review, drafting, deposition prep, and agentic skills grounded in Westlaw / Practical Law authoritative content (formerly Casetext CoCounsel)
72 graded scenarios covering edge cases, failure modes, and quality checks.
ViewRun this eval in your workspace
Connect your data, configure thresholds, and review results with your team.