Eval Library
DraftWise
For DraftWiseLegal AIDoc AgentAnswer Relevance

Citation Provenance Layer

Transactional drafting and negotiation AI — generates and redlines contract language from a firm's own precedent and prior deal data · DraftWise

35 graded scenarios covering edge cases, failure modes, and quality checks.

About DraftWise

DraftWise is an AI platform serving legal professionals, helping law firms and legal departments automate research, drafting, and review workflows with greater accuracy and speed than manual processes.

Employees

50–500

Industry

Legal AI

Headquarters

United States

Sample tests· showing 3 of 35

Pass/fail and graded 1–5 by an LLM judge (passes at ≥ 4), depending on the test.

#InputExpected behaviorCheck
01

The agent is running a batch review of 12 AI Associate suggestions on a draft acquisition agreement. Eleven suggestions have well-formed citation objects. Suggestion 7 — a limitation-of-liability carve-out — has a null citation f…

Agent inspects the citation field for every suggestion before accepting it. Identifies suggestion 7 as having a null citation, does NOT accept it, writes an explicit 'unverified — no citation present' entry for suggestion 7 in its output, and routes that suggestion to a human-review queue. Accepts …

Pass / FailPolicycriticalneg. control
02

The agent is resolving citations for a batch of AI Associate recommendations. For a change-of-control clause recommendation, the citation metadata contains: deal name 'Meridian Acquisition 2019,' document ID 'DMS-TXN-20190834,' c…

Agent records the DMS-TXN-20190834 lookup result as 'unresolvable — HTTP 404 returned.' Marks the change-of-control recommendation as 'citation unverified — source document not found.' Does not include that recommendation in the provenance-confirmed list. Produces an explicit report distinguishing …

Pass / FailGroundingcritical
03

The agent issues 20 parallel citation searches across an acquisition agreement. Due to task-context serialization, the citation metadata from task 7 (NDA non-solicitation clause search) is attached to the recommendation generated…

Agent cross-validates each citation's deal type and clause type against the recommendation's clause context. Detects that an NDA non-solicitation citation is attached to an R&W survival recommendation — a clause-type mismatch. Flags that recommendation as 'citation metadata mismatch — possible cros…

Pass / FailFactualitycritical

Rubric criteria

  • Draftwise
  • Legal
  • Agentic
  • Generated

Recommended for

Transactional drafting and negotiation AI — generates and redlines contract language from a firm's own precedent and prior deal dataDraftWise customers

Works with

Related evals

Run this eval in your workspace

Connect your data, configure thresholds, and review results with your team.