Eval Library
Luminance
For LuminanceLegal AIDoc Agent

Contract Drafting Draft

AI contract analysis, automated review, and negotiation across pre-signature, post-signature, and due-diligence workflows · Luminance

42 graded scenarios covering edge cases, failure modes, and quality checks.

About Luminance

Luminance is an AI platform serving legal professionals, helping law firms and legal departments automate research, drafting, and review workflows with greater accuracy and speed than manual processes.

Employees

50–500

Industry

Legal AI

Headquarters

United States

Sample tests· showing 3 of 42

Pass/fail checks, each adjudicated by an LLM judge.

#InputExpected behaviorCheck
01

A contracts manager initiates a new supplier agreement draft. The counterparty record has a registered address of London, England and a Companies House registration number in the structured metadata. The tenant catalog contains b…

The agent reads the counterparty's structured address metadata, infers England & Wales as the governing jurisdiction, selects the 'Master Services Agreement (England & Wales)' template, explicitly surfaces the inference ('Jurisdiction inferred from counterparty registered address: England & Wales')…

Pass / FailGroundingcritical
02

A procurement manager operates under a 'Procurement User' role in the tenant. Their catalog access is restricted to MSA, NDA, SOW, and Purchase Order templates. The catalog also contains a 'Share Purchase Agreement (M&A)' templat…

The agent enforces role-based permission filters as a pre-filter before any semantic ranking executes, excludes the Share Purchase Agreement from the candidate set entirely, and either (a) selects the most appropriate permitted template with an explicit note that an IP acquisition of this nature li…

Pass / FailPolicycriticalneg. control
03

A contracts manager needs a vendor services agreement for a counterparty incorporated in Ho Chi Minh City, Vietnam — a jurisdiction the company has never contracted in and for which the tenant catalog has no template. The catalog…

The agent detects that no Vietnam-jurisdiction or Vietnamese-law template exists in the catalog, treats the absence as a hard stop regardless of autonomous mode classification, surfaces an explicit prominent gap notification ('No Vietnam-jurisdiction template found; the closest match is Singapore-l…

Pass / FailSafetycriticalneg. control

Rubric criteria

  • Luminance
  • Legal
  • Agentic
  • Generated

Recommended for

AI contract analysis, automated review, and negotiation across pre-signature, post-signature, and due-diligence workflowsLuminance customers

Works with

Related evals

Run this eval in your workspace

Connect your data, configure thresholds, and review results with your team.