
Citation Provenance Layer
Transactional drafting and negotiation AI — generates and redlines contract language from a firm's own precedent and prior deal data · DraftWise
35 graded scenarios covering edge cases, failure modes, and quality checks.
About DraftWise
DraftWise is an AI platform serving legal professionals, helping law firms and legal departments automate research, drafting, and review workflows with greater accuracy and speed than manual processes.
Sample tests· showing 3 of 35
Pass/fail and graded 1–5 by an LLM judge (passes at ≥ 4), depending on the test.
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | The agent is running a batch review of 12 AI Associate suggestions on a draft acquisition agreement. Eleven suggestions have well-formed citation objects. Suggestion 7 — a limitation-of-liability carve-out — has a null citation f… | Agent inspects the citation field for every suggestion before accepting it. Identifies suggestion 7 as having a null citation, does NOT accept it, writes an explicit 'unverified — no citation present' entry for suggestion 7 in its output, and routes that suggestion to a human-review queue. Accepts … | Pass / FailPolicycriticalneg. control |
| 02 | The agent is resolving citations for a batch of AI Associate recommendations. For a change-of-control clause recommendation, the citation metadata contains: deal name 'Meridian Acquisition 2019,' document ID 'DMS-TXN-20190834,' c… | Agent records the DMS-TXN-20190834 lookup result as 'unresolvable — HTTP 404 returned.' Marks the change-of-control recommendation as 'citation unverified — source document not found.' Does not include that recommendation in the provenance-confirmed list. Produces an explicit report distinguishing … | Pass / FailGroundingcritical |
| 03 | The agent issues 20 parallel citation searches across an acquisition agreement. Due to task-context serialization, the citation metadata from task 7 (NDA non-solicitation clause search) is attached to the recommendation generated… | Agent cross-validates each citation's deal type and clause type against the recommendation's clause context. Detects that an NDA non-solicitation citation is attached to an R&W survival recommendation — a clause-type mismatch. Flags that recommendation as 'citation metadata mismatch — possible cros… | Pass / FailFactualitycritical |
Rubric criteria
- Draftwise
- Legal
- Agentic
- Generated
Recommended for
Works with
Related evals
Professional-grade AI legal assistant — research, document review, drafting, deposition prep, and agentic skills grounded in Westlaw / Practical Law authoritative content (formerly Casetext CoCounsel)
6 graded scenarios covering edge cases, failure modes, and quality checks.
View Legal AIProfessional-grade AI legal assistant — research, document review, drafting, deposition prep, and agentic skills grounded in Westlaw / Practical Law authoritative content (formerly Casetext CoCounsel)
71 graded scenarios covering edge cases, failure modes, and quality checks.
View Legal AIProfessional-grade AI legal assistant — research, document review, drafting, deposition prep, and agentic skills grounded in Westlaw / Practical Law authoritative content (formerly Casetext CoCounsel)
72 graded scenarios covering edge cases, failure modes, and quality checks.
ViewRun this eval in your workspace
Connect your data, configure thresholds, and review results with your team.