Eval Library
vLex (Vincent AI)
For vLex (Vincent AI)Legal AIDoc Agent

Vlex Ask A Research Question Grounded Legal Q A

Global legal research platform with the Vincent AI agent — multi-step research, document analysis, drafting, and workflow building over a 1B+ document global law collection · vLex (Vincent AI)

58 graded scenarios covering edge cases, failure modes, and quality checks.

About vLex (Vincent AI)

vLex (Vincent AI) is an AI platform serving legal professionals, helping law firms and legal departments automate research, drafting, and review workflows with greater accuracy and speed than manual processes.

Employees

50–500

Industry

Legal AI

Headquarters

United States

Sample tests· showing 3 of 58

Pass/fail and graded 1–5 by an LLM judge (passes at ≥ 4), depending on the test.

#InputExpected behaviorCheck
01

An agentic brief-drafting workflow submits a focused employment-law query explicitly scoped to Illinois state law. The agent is configured to extract all citations listed under 'controlling authority' from the memo and insert the…

The memo places only Illinois Supreme Court decisions, Illinois Appellate Court decisions, and Illinois Human Rights Act statutory text under any heading that conveys binding or controlling authority. Any Seventh Circuit or other federal decision is placed in a clearly labeled 'Persuasive Authority…

Pass / FailGroundingcritical
02

An associate asks Vincent for Illinois contract interpretation law and explicitly requests federal cases applying Illinois law be included. The corpus returns a mix of Illinois Supreme Court opinions and Seventh Circuit diversity…

The memo contains a 'Controlling Illinois Authority' section (Illinois Supreme Court and Appellate decisions, Illinois statutes) and a separate 'Persuasive Federal Authority' section (Seventh Circuit diversity opinions). Each Seventh Circuit citation carries a parenthetical identifying it as a dive…

Pass / FailGroundinghigh
03

An agentic due-diligence workflow generates a memo on the California implied covenant of good faith and fair dealing in commercial contracts between sophisticated parties. The agent is programmed to extract each citation from the…

Every citation string in the memo (case name, reporter volume, first page, pinpoint page) resolves via its hyperlink to a real vLex document. The document title matches the case name in the citation. The reporter volume and series match the citation string. The pinpoint page cited falls within the …

Pass / FailFactualitycritical

Rubric criteria

  • Vlex
  • Legal
  • Agentic
  • Generated

Recommended for

Global legal research platform with the Vincent AI agent — multi-step research, document analysis, drafting, and workflow building over a 1B+ document global law collectionvLex (Vincent AI) customers

Works with

Related evals

Run this eval in your workspace

Connect your data, configure thresholds, and review results with your team.