Autonomous Negotiation Formerly Autopilot
AI contract analysis, automated review, and negotiation across pre-signature, post-signature, and due-diligence workflows · Luminance
53 graded scenarios covering edge cases, failure modes, and quality checks.
About Luminance
Luminance is an AI platform serving legal professionals, helping law firms and legal departments automate research, drafting, and review workflows with greater accuracy and speed than manual processes.
Sample tests· showing 3 of 53
Pass/fail and graded 1–5 by an LLM judge (passes at ≥ 4), depending on the test.
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | A Contracts Manager uploads a 42-page DOCX software license agreement that has 23 open tracked changes — counterparty deletions of the limitation-of-liability clause (Section 14.2) and additions of a most-favored-nation pricing c… | Before creating any negotiation record or parsing clause structure, the agent presents a blocking disambiguation prompt that names both possible bases (accepted/clean version vs. current-markup/redlined version), identifies at least the LoL clause and the MFN clause as materially differing between … | Pass / FailPolicycriticalneg. control |
| 02 | A Contracts Manager uploads a scanned PDF of a 12-page bilateral NDA produced at 150 dpi with a 2-degree page skew and light toner artifacts over portions of Section 5. The document contains exactly: three defined terms ('Confide… | The agent extracts all three defined terms verbatim, both dollar amounts without digit transposition or omission, and all four dates without error. Where OCR confidence on any token falls below the system threshold, the agent flags the specific clause and character span for human review before proc… | Score 1–5 · pass ≥ 4Factualitycritical |
| 03 | A Contracts Manager uploads a three-file package: (1) a 60-page MSA body with a $1M limitation-of-liability clause in Section 18; (2) Schedule C (Liability and Indemnification) uploaded as a separate PDF, which explicitly superse… | The agent assembles all three files into a single unified contract object, applies the conflict-resolution rule from Section 1, and represents the operative liability cap as $5M (the Schedule C figure) in all analysis outputs, redlines, and counterparty communications. It does not treat Schedule C … | Pass / FailWorkflowcritical |
Rubric criteria
- Luminance
- Legal
- Agentic
- Generated
Recommended for
Works with
Related evals
Professional-grade AI legal assistant — research, document review, drafting, deposition prep, and agentic skills grounded in Westlaw / Practical Law authoritative content (formerly Casetext CoCounsel)
6 graded scenarios covering edge cases, failure modes, and quality checks.
View Legal AIProfessional-grade AI legal assistant — research, document review, drafting, deposition prep, and agentic skills grounded in Westlaw / Practical Law authoritative content (formerly Casetext CoCounsel)
71 graded scenarios covering edge cases, failure modes, and quality checks.
View Legal AIProfessional-grade AI legal assistant — research, document review, drafting, deposition prep, and agentic skills grounded in Westlaw / Practical Law authoritative content (formerly Casetext CoCounsel)
72 graded scenarios covering edge cases, failure modes, and quality checks.
ViewRun this eval in your workspace
Connect your data, configure thresholds, and review results with your team.