Evals for Superlegal

Risk-clause detection and severity framing

Identifies indemnity, limitation-of-liability, termination, IP-assignment, and payment-term provisions that are off-market or one-sided, and explains the business consequence rather than only naming the clause.

Ambiguity and contradiction surfacing

Flags vague, undefined, or internally contradictory language consistent with the product's own 'Ambiguous Contract' framing, including defined terms used inconsistently across sections.

Contract-type-aware review

Applies the right lens per document type — DPA data-protection terms, construction flow-down and change-order mechanics, SaaS licensing scope — instead of a single generic checklist.

Missing-provision detection

Notes protections a market-standard agreement of that type would normally contain but this draft omits.

Redline generation and fidelity

Produces specific replacement or inserted language that is legally coherent, scoped to the flagged issue, and does not silently alter unrelated terms.

Fallback and position laddering

Offers a preferred position plus an acceptable fallback so the client can concede in a controlled order during negotiation.

Counterparty-response handling

Interprets the other side's counter-redlines and advises whether the revised term remains acceptable.

Rationale and explanation quality

Explains each redline in terms a non-lawyer owner of the deal can act on, per the product's stated non-lawyer audience.

Escalation to human review

Routes contracts or clauses that exceed automated confidence to attorney verification rather than releasing an unverified output.

Verification-state transparency

Makes clear to the user which output has been attorney-verified and which has not, without overstating the review that occurred.

Advice-boundary discipline

Distinguishes contract review within scope from litigation, tax, or jurisdiction-specific counsel that falls outside the subscription, and declines or refers appropriately.

Uncertainty signaling

States when a term's enforceability or interpretation is genuinely unsettled instead of asserting a confident position.

Credit accounting and consumption

Correctly computes credits consumed for a submission, including doubling for complex contracts at ten pages or more, and reflects the remaining annual balance.

Turnaround SLA representation

Communicates the review window that matches the customer's actual plan tier and does not promise faster than the tier supports.

Tier and entitlement accuracy

Answers plan-comparison and eligibility questions consistently with published inclusions such as integrations, SSO add-on, and negotiation support.

Balance-exhaustion handling

Behaves sensibly when credits run low or out — surfacing the constraint and options rather than silently proceeding.

Obligation and key-date extraction

Pulls renewal dates, notice periods, deliverable deadlines, and payment milestones out of executed agreements into trackable records.

Reminder scheduling and lead time

Sets customizable proactive reminders far enough ahead that a notice or renewal window can still be acted on.

Full-text search and retrieval

Returns the correct contract and the specific governing passage for a natural-language question across the repository.

Cross-department visibility

Presents obligations to the owning team without exposing contracts beyond a user's permitted scope.

Permission enforcement

Restricts contract visibility and actions to what a user's role permits, including across the Organize repository.

Approval-flow routing

Moves a reviewed contract through the configured approvers in order and blocks execution until required approvals land.

Reviewer-name personalization

Applies the configured reviewer identity consistently on outputs for accounts entitled to it.

Integration and SSO behavior

Honors integration and SSO configuration, including that SSO is a Premium add-on rather than a default inclusion.