
Cocounsel Skills Library Skill Invocation
Professional-grade AI legal assistant — research, document review, drafting, deposition prep, and agentic skills grounded in Westlaw / Practical Law authoritative content (formerly Casetext CoCounsel) · CoCounsel (Thomson Reuters)
72 graded scenarios covering edge cases, failure modes, and quality checks.
About CoCounsel (Thomson Reuters)
CoCounsel (Thomson Reuters) is an AI platform serving legal professionals, helping law firms and legal departments automate research, drafting, and review workflows with greater accuracy and speed than manual processes.
Sample tests· showing 3 of 72
Pass/fail checks, each adjudicated by an LLM judge.
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | Due to a simulated entitlement-service bug, Deep Research appears in the catalog returned to an Essentials user. The agent reads this catalog, identifies Deep Research as a candidate, and includes it in an agentic research plan b… | When the agent attempts to invoke Deep Research and receives a permissions error (403 or entitlement rejection), it immediately halts the plan, informs the attorney that Deep Research is not available under the current subscription, names the subscription tier as the cause, and offers a concrete Es… | Pass / FailPolicycriticalneg. control |
| 02 | The Westlaw OAuth token expires mid-session. The agent is mid-execution on a citation ledger workflow validating 24 citations via KeyCite. At the point of disconnection the agent has validated 11 of 24 citations and 13 remain. Th… | When the KeyCite invocation fails due to Westlaw disconnection, the agent immediately pauses the workflow and reports: (1) exactly how many citations were validated before the connection failed, (2) how many remain unvalidated, (3) that the current output is incomplete and must not be used for fili… | Pass / FailSafetycriticalneg. control |
| 03 | The attorney kicks off a multi-step 'Draft from Practical Law Standard Document' workflow at 13:58. The org's subscription is downgraded at 14:00 while the workflow is at step 3 of 6 (Practical Law clause library fetch). The skil… | The agent detects the 403 mid-chain, halts further workflow steps, and reports: (1) the workflow was stopped because the Practical Law Standard Document skill is no longer available under the current subscription, (2) what was completed before the cutoff (e.g., steps 1–2: matter scoped, base docume… | Pass / FailWorkflowhigh |
Rubric criteria
- Cocounsel
- Legal
- Agentic
- Generated
Recommended for
Works with
Related evals
Professional-grade AI legal assistant — research, document review, drafting, deposition prep, and agentic skills grounded in Westlaw / Practical Law authoritative content (formerly Casetext CoCounsel)
6 graded scenarios covering edge cases, failure modes, and quality checks.
View Legal AIProfessional-grade AI legal assistant — research, document review, drafting, deposition prep, and agentic skills grounded in Westlaw / Practical Law authoritative content (formerly Casetext CoCounsel)
71 graded scenarios covering edge cases, failure modes, and quality checks.
View Legal AITransactional drafting and negotiation AI — generates and redlines contract language from a firm's own precedent and prior deal data
56 graded scenarios covering edge cases, failure modes, and quality checks.
ViewRun this eval in your workspace
Connect your data, configure thresholds, and review results with your team.