Eval Library
LexisNexis
For LexisNexisLegal AIDoc AgentAnswer Relevance

Grounded Legal Research Conversational Q A

Lexis+ AI and Protégé — conversational legal research, drafting, summarization, and document analysis grounded in LexisNexis authoritative content and Shepard's Citations · LexisNexis

66 graded scenarios covering edge cases, failure modes, and quality checks.

About LexisNexis

LexisNexis is an AI platform serving legal professionals, helping law firms and legal departments automate research, drafting, and review workflows with greater accuracy and speed than manual processes.

Employees

50–500

Industry

Legal AI

Headquarters

United States

Sample tests· showing 3 of 66

Pass/fail checks, each adjudicated by an LLM judge.

#InputExpected behaviorCheck
01

An agent is generating an automated compliance checklist for a client with operations in California, New York, and Texas. It submits a free-form research query about termination notice requirements without specifying any jurisdic…

The system (1) surfaces notice requirements from at least federal WARN, California WARN (Cal-WARN), and New York WARN Act; (2) labels each rule with the jurisdiction it applies to; (3) includes an explicit textual statement — present in the extractable answer body, not only in a tooltip or sidebar …

Pass / FailGroundingcritical
02

An agent operating in an automated due-diligence pipeline is instructed to 'research all applicable employee-notice laws for a workforce reduction.' No target jurisdiction is specified in the task payload. The agent has the abili…

The agent pauses execution, emits a structured clarification request that explicitly lists the jurisdictions it needs specified (or asks for the list of states where the client has employees), and does NOT produce any compliance output until jurisdiction scope is confirmed. The clarification reques…

Pass / FailWorkflowcriticalneg. control
03

An agent is tasked with comparing non-compete enforceability across California and Texas to recommend governing law for maximum enforceability. It submits a multi-jurisdictional synthesis query. The pipeline extracts the recommen…

The response accurately states that California Business & Professions Code § 16600 renders non-compete agreements void and unenforceable with narrow exceptions, and that Texas enforces non-competes if they are reasonable in scope, duration, and geographic area and supported by adequate consideratio…

Pass / FailFactualitycritical

Rubric criteria

  • Lexisnexis
  • Legal
  • Agentic
  • Generated

Recommended for

Lexis+ AI and Protégé — conversational legal research, drafting, summarization, and document analysis grounded in LexisNexis authoritative content and Shepard's CitationsLexisNexis customers

Works with

Related evals

Run this eval in your workspace

Connect your data, configure thresholds, and review results with your team.