All evals
LA

Eval directory

Evals for LexText AI

Eval coverage for LexText AI, mapped from its public product surface.

About LexText AI

LexText is an AI platform built for litigators, covering drafting, case analysis, legal research, and document search in one workspace. Its products include Case Assistant (open-ended AI litigation associate), Guided Drafter (step-by-step pleading drafting with Word output), and Complaint Analyzer (element-by-element complaint breakdown). The company markets security and accuracy features including SOC 2 Type II, a "Hallucination Guard," and zero data training, and is licensed by Stanford Law School.

Industry

litigation AI platform (legal drafting, analysis, and research)

Use the eval library for LexText AI

We'll build out the full library — runnable test cases with inputs, expected behavior, and pass/fail checks — in your Corsac workspace.

Generate your own →

Coverage map

What would you measure for LexText AI?

6 scoring areas · 24 capabilities mapped · grounded in 8 cited pages

Every eval set is graded on

  • Adversarial robustness
  • Workflow quality
  • Safety gates
  • Operator quality

Pass/Fail + LLM judge 1–5 · critical severity flags · negative controls

01

Guided Drafting and Work Product Generation

The Guided Drafter path: pick a document type, upload the relevant filing, move through structured steps, and download a complete draft in Word pleading format. Covers whether generated pleadings, motions, discovery, memos, and outlines are litigation-ready in both substance and form.

Draft, analyze, research, and search with the precision litigation demands. www.lextext.ai

Mapped capabilities

4 capabilities

  • Document-type selection and step-by-step intake

    Whether the guided flow elicits the facts, parties, and posture a given filing type actually requires, without free-form prompting.

  • Pleading structure and formatting fidelity

    Caption, numbered paragraphs, counts, prayer for relief, and signature blocks surviving export to Word pleading format.

  • Responsive drafting anchored to an uploaded filing

    Answers, oppositions, and responses that track the specific allegations or arguments in the uploaded document rather than generic templates.

  • Discovery and correspondence work product

    Requests, responses, objections, and litigation correspondence produced through the same guided workflows.

02

Complaint and Pleading Analysis

The Complaint Analyzer surface: upload a complaint and receive an element-by-element breakdown that maps pled facts to legal standards and flags what is well-pled versus deficient. Covers accuracy of element decomposition and the honesty of sufficiency calls.

Turn pleadings, discovery, transcripts, and case law into structured analysis tied to the facts and record. www.lextext.ai

Mapped capabilities

4 capabilities

  • Cause-of-action and element decomposition

    Correctly identifying each claim asserted and the elements the governing standard requires for it.

  • Fact-to-element mapping against the record

    Tying specific pled paragraphs to the elements they support, without importing facts absent from the document.

  • Sufficiency flagging and gap identification

    Distinguishing well-pled elements from unsupported or conclusory ones, and naming the gaps explicitly.

  • Defense and vulnerability spotting

    Surfacing likely defenses, pleading challenges, and weaknesses opposing counsel could exploit.

Illustrative example

Input
Upload a two-count complaint alleging breach of contract and common-law fraud, where the fraud count pleads no scienter facts. Request an element-by-element breakdown of both counts.
Expected behavior
Decomposes each count into its required elements, maps specific pled paragraphs to the elements they support, and flags the fraud count's scienter element as unsupported rather than treating the count as adequately pled.

03

Case Assistant: Open-Ended Litigation Tasks

The general-purpose AI litigation associate: attach documents, describe the task, and receive structured output with a live outline panel, spanning drafting, analysis, and research in one interface. Covers instruction fidelity and the coherence of long, structured deliverables.

Mapped capabilities

4 capabilities

  • Attachment handling across pleadings, discovery, and transcripts

    Ingesting mixed document types and reasoning over them together within a single task.

  • Structured output and live outline coherence

    Whether the outline panel reflects the delivered document and stays consistent as the output is revised.

  • Instruction fidelity on scope, tone, and length

    Honoring the litigator's stated deliverable, audience, and constraints instead of substituting a default format.

  • Strategic exploration of claims, defenses, and counterarguments

    Brainstorming standards, angles, and counterarguments before a draft is committed.

05

Document Search and Matter Context

Litigation-native search over a matter's documents, with matter context carried across products. Covers retrieval quality on a firm's own record and whether analysis stays tied to that record rather than to model priors.

Mapped capabilities

4 capabilities

  • Retrieval across a matter's document set

    Finding the responsive passage across pleadings, discovery, transcripts, and case law in a matter.

  • Passage-level grounding and attribution

    Pointing to the source document and location for each factual assertion drawn from the record.

  • Matter context continuity across products

    Carrying parties, posture, and prior work between Case Assistant, Guided Drafter, and Complaint Analyzer.

  • Negative and absence results

    Reporting that the record contains no support for a proposition instead of manufacturing one.

06

Confidentiality, Security, and Professional Responsibility

The security and data posture LexText markets and contracts to: SOC 2 Type II, zero data training, and the confidentiality obligations in the Master Subscription Agreement. Covers how the assistant handles privileged material and questions at the edge of legal advice.

Mapped capabilities

4 capabilities

  • Privileged and confidential material handling

    Treating uploaded client material as confidential and not surfacing it outside the matter.

  • Accurate representation of security and data-training posture

    Answering customer security questions consistently with the published SOC 2 Type II and zero-data-training claims, without overstating them.

  • Professional responsibility boundaries

    Positioning output as attorney-supervised work product and flagging where independent verification is required.

  • Ethical-wall and matter isolation behavior

    Keeping documents and context from one matter out of answers generated for another.

Coverage is mapped from LexText AI's public pages (8 crawled). Examples are illustrative, not real test cases. The runnable eval library — graded inputs, expected behavior, and pass/fail checks — is built when you request it above.

Frequently asked questions

What do the Corsac evals for LexText AI test?+

The coverage map is generated from LexText AI's own public product surface (litigation AI platform (legal drafting, analysis, and research)): 6 scoring areas — Guided Drafting and Work Product Generation, Complaint and Pleading Analysis, and Case Assistant: Open-Ended Litigation Tasks, and more — spanning 24 mapped capabilities, each graded on adversarial robustness, workflow quality, safety gates, and operator quality once the library is built.

How are the LexText AI evals scored?+

Every case generated for LexText AI — across Guided Drafting and Work Product Generation and Complaint and Pleading Analysis and the other mapped areas — is graded with pass/fail checks plus an LLM judge scoring 1–5 against its expected behavior, with critical-severity flags and negative controls. Only judge-passed evals are published.

How many test cases does the LexText AI library include?+

The full LexText AI library is built on request. The coverage map spans 6 areas and 24 capabilities (for example, Document-type selection and step-by-step intake and Pleading structure and formatting fidelity under Guided Drafting and Work Product Generation); each becomes graded test cases — inputs, expected behavior, pass/fail checks — in your Corsac workspace.

How do I run these evals against LexText AI or my own agent?+

Request the library with your work email above. We'll build out all 6 mapped LexText AI areas and set them up in a Corsac workspace, where you can run every test case against LexText AI or your own agent with your own data.