Evals for LegalOn

Risk issue spotting in context

Identifies missing, one-sided, or unusual terms with reference to the clause's role in the agreement; avoids flagging conforming clauses.

Position-aware redline generation

Proposes revised language appropriate to the party the reviewer represents, not a generic neutral rewrite.

Edit application and document hygiene

Applied edits preserve clause numbering, cross-references, and defined-term usage after insertion or deletion.

Word-integrated review flow

Review and edit application operate on the document inside the Word workflow described in the platform surface.

Deviation detection against a playbook rule

Correctly classifies a clause as conforming, deviating, or missing relative to a specific stated standard.

Fallback and escalation positions

Distinguishes preferred from acceptable fallback language and escalates when a term falls outside both.

Reviewer-to-reviewer consistency

The same contract and playbook produce the same set of flagged deviations across repeated runs.

Out-of-the-box playbook coverage

Pre-built playbooks for common agreement types apply without customer configuration.

Clause drafting to a stated standard

Generates language that satisfies the requested protection or allocation without introducing unrequested terms.

Rewriting existing provisions

Rewrites a supplied clause to change a specific term while leaving unrelated obligations intact.

Template-grounded drafting

Drafts start from the applicable attorney-built template for the agreement type rather than free-form generation.

Definition and internal consistency

New language reuses the document's existing defined terms instead of inventing parallel definitions.

Grounded answers over the open document

Answers cite the governing clause and decline when the document does not address the question.

Library-wide retrieval

Locates the relevant prior contract or provision across the library and attributes the answer to its source.

One-click skills

Issue-list generation, key-clause extraction, and defined-term checking return complete, non-duplicated results.

Obligation summarization

Summaries capture the operative obligation, trigger, and deadline without softening or overstating them.

Key-term extraction into structured fields

Extracts terms such as term length, renewal mechanics, and notice periods into consistent, typed fields.

Renewal and expiry risk surfacing

Correctly identifies which agreements renew or lapse within a stated window, including notice deadlines.

Portfolio-level filtered queries

Multi-condition queries across the repository return the complete matching set with no out-of-scope contracts.

Provenance and citation

Every extracted value or query result traces back to the specific source contract and clause.

Request capture and structuring

Converts an inbound request into a matter with the requester, agreement type, counterparty, and asked-for outcome.

Matter summarization

Produces a summary a second attorney could pick the matter up from without rereading the thread.

Prior-matter recommendation

Surfaces relevant past matters for a new request and explains the basis for the match.

Status and ownership tracking

Matter state and assignee remain accurate as the request moves from intake through completion.