Eval Library
CoCounsel (Thomson Reuters)
For CoCounsel (Thomson Reuters)Legal AIDoc AgentAnswer Relevance

Cocounsel Deep Research Westlaw Grounded Retrieval

Professional-grade AI legal assistant — research, document review, drafting, deposition prep, and agentic skills grounded in Westlaw / Practical Law authoritative content (formerly Casetext CoCounsel) · CoCounsel (Thomson Reuters)

6 graded scenarios covering edge cases, failure modes, and quality checks.

About CoCounsel (Thomson Reuters)

CoCounsel (Thomson Reuters) is an AI platform serving legal professionals, helping law firms and legal departments automate research, drafting, and review workflows with greater accuracy and speed than manual processes.

Employees

50–500

Industry

Legal AI

Headquarters

United States

Sample tests· showing 3 of 6

Pass/fail checks, each adjudicated by an LLM judge.

#InputExpected behaviorCheck
01

An associate opens a new CoCounsel Deep Research session and submits an employment non-compete enforceability question with no state, county, or geographic signal anywhere in the text. No prior session context or client matter pr…

Before formulating or executing any research plan, the agent either (a) asks a clarifying question naming jurisdiction as the blocking unknown and pauses execution, or (b) surfaces an explicit statement such as 'I am assuming [State X] because [stated reason] — please confirm or correct before I pr…

Pass / FailPolicycriticalneg. control
02

An associate is advising a California-resident software engineer whose former New York-headquartered employer is asserting breach of a signed non-disclosure and non-solicitation agreement. Both states are named in a single query …

The research plan explicitly identifies both California and New York as implicated jurisdictions. It sequences a choice-of-law analysis step — examining which state's law governs under the contract's choice-of-law clause and conflict-of-laws principles — as step 1 or step 2, before any substantive …

Pass / FailWorkflowcritical
03

An associate advises a client who was verbally promised enhanced severance by their employer during a reduction in force. The employer's written plan pays a lower amount. The associate asks only about state contract claims — fede…

The plan includes an explicit step — sequenced before or in parallel with state contract claims — to investigate whether the employer's severance arrangement constitutes an ERISA-governed employee welfare benefit plan under 29 U.S.C. § 1001 et seq. The plan notes that ERISA § 514 broadly preempts s…

Pass / FailFactualitycritical

Rubric criteria

  • Cocounsel
  • Legal
  • Agentic
  • Generated

Recommended for

Professional-grade AI legal assistant — research, document review, drafting, deposition prep, and agentic skills grounded in Westlaw / Practical Law authoritative content (formerly Casetext CoCounsel)CoCounsel (Thomson Reuters) customers

Works with

Related evals

Run this eval in your workspace

Connect your data, configure thresholds, and review results with your team.