Cocounsel Guided Agentic Workflows
Professional-grade AI legal assistant — research, document review, drafting, deposition prep, and agentic skills grounded in Westlaw / Practical Law authoritative content (formerly Casetext CoCounsel) · CoCounsel (Thomson Reuters)
71 graded scenarios covering edge cases, failure modes, and quality checks.
About CoCounsel (Thomson Reuters)
CoCounsel (Thomson Reuters) is an AI platform serving legal professionals, helping law firms and legal departments automate research, drafting, and review workflows with greater accuracy and speed than manual processes.
Sample tests· showing 3 of 71
Pass/fail checks, each adjudicated by an LLM judge.
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | Am Law associate triggers 'Draft a Complaint' for a California breach-of-contract matter, uploading a 3-page engagement letter. The rendered plan contains exactly 6 labeled steps: (1) Extract parties and facts from uploaded docum… | Execution log shows exactly 6 tool/step invocations, in the displayed ordinal sequence. Step 2 invokes Westlaw with a California jurisdiction parameter. No additional tool calls appear (e.g., a federal case law lookup, a PACER call, a second Westlaw query for a different jurisdiction). No displayed… | Pass / FailWorkflowcritical |
| 02 | The underlying LLM returns a single streamed response containing both the structured plan JSON and the text of step 1's draft output (a facts-and-parties section). The UI layer and agent runtime receive this combined response. Th… | The system parses the streaming response and displays only the structured plan to the user. The step-1 draft embedded in the LLM response is held in a buffer and not rendered to the user and not forwarded as input to step 2. A distinct, explicit user action (button click or equivalent confirmation)… | Pass / FailPolicycritical |
| 03 | Associate explicitly specifies California Superior Court, Los Angeles County, for a wage-and-hour class action. Grader inspects every step of the generated plan for jurisdiction specificity, checking both the plan header and the … | Plan header explicitly states 'Jurisdiction: California Superior Court, Los Angeles County'. Legal research step references California Labor Code §§ 226.7 and 512, and California Code of Civil Procedure class-action provisions. No step references FRCP Rule 23, federal FLSA, New York Labor Law, or a… | Pass / FailFactualitycritical |
Rubric criteria
- Cocounsel
- Legal
- Agentic
- Generated
Recommended for
Works with
Related evals
Professional-grade AI legal assistant — research, document review, drafting, deposition prep, and agentic skills grounded in Westlaw / Practical Law authoritative content (formerly Casetext CoCounsel)
6 graded scenarios covering edge cases, failure modes, and quality checks.
View Legal AIProfessional-grade AI legal assistant — research, document review, drafting, deposition prep, and agentic skills grounded in Westlaw / Practical Law authoritative content (formerly Casetext CoCounsel)
72 graded scenarios covering edge cases, failure modes, and quality checks.
View Legal AITransactional drafting and negotiation AI — generates and redlines contract language from a firm's own precedent and prior deal data
56 graded scenarios covering edge cases, failure modes, and quality checks.
ViewRun this eval in your workspace
Connect your data, configure thresholds, and review results with your team.