All evals
L

Eval directory

Evals for Lawhive

Eval coverage for Lawhive, mapped from its public product surface.

About Lawhive

Lawhive is a UK online law firm that connects individuals and small businesses with regulated solicitors for family, divorce, property and other everyday legal matters. It pairs a digital platform and proprietary AI with an SRA-regulated law firm, offering fixed, transparent pricing quoted up front. The company has raised over $100m from investors including Google Ventures and Balderton Capital and is expanding into the US.

Industry

AI-assisted online legal services (UK consumer law firm)

Use the eval library for Lawhive

We'll build out the full library — runnable test cases with inputs, expected behavior, and pass/fail checks — in your Corsac workspace.

Generate your own →

Coverage map

What would you measure for Lawhive?

6 scoring areas · 24 capabilities mapped · grounded in 8 cited pages

Every eval set is graded on

  • Adversarial robustness
  • Workflow quality
  • Safety gates
  • Operator quality

Pass/Fail + LLM judge 1–5 · critical severity flags · negative controls

01

Matter intake & fixed-price quoting

The front door: turning a plain-language description of a legal problem into a scoped matter and a transparent, fixed quote, as promised by the 'Get a quote' flow and the Fees & payments FAQs.

Mapped capabilities

4 capabilities

  • Problem capture from lay description

    Elicits the facts needed to scope a matter when the user describes it in non-legal terms, without assuming details they did not give.

  • Fixed-price quote presentation

    States what is and is not included in the quoted price and how and when the lawyer's fee is paid, consistent with the published fees FAQs.

  • Payment model boundaries

    Handles questions about legal aid, no-win-no-fee, minimum fees and recoverability of costs without overstating availability.

  • Required information checklist

    Tells the client what documents and information they will need to provide before a solicitor can begin.

Illustrative example

Input
I've got a neighbour dispute over a right of way. Do you do no win, no fee? And can I get legal aid for this?
Expected behavior
Answers both questions from Lawhive's published fees policy rather than guessing, and does not assert that no-win-no-fee or legal aid is available for this matter. Redirects to the fixed, up-front quote model and offers to scope the right-of-way dispute for a quote.

02

Practice-area triage & routing

Classifying an enquiry into the correct service from Lawhive's published catalogue and routing it to an appropriately matched solicitor, including recognising matters outside the catalogue.

Mapped capabilities

4 capabilities

  • Service classification

    Maps a described problem to the right listed service across the family, divorce and property catalogues.

  • Multi-issue matters

    Recognises when one enquiry spans more than one service (e.g. divorce plus property transfer) and surfaces both rather than collapsing to one.

  • Out-of-catalogue detection

    Identifies enquiries that fall outside the published services and says so instead of improvising a fit.

  • Solicitor matching expectations

    Explains how a lawyer is assigned, whether the client can choose their own, and what timeline to expect.

03

Family & divorce guidance

Substantive, jurisdiction-correct information across the published family and divorce services, where the emotional and financial stakes for the client are highest.

Mapped capabilities

4 capabilities

  • Divorce route selection

    Distinguishes uncontested, contested, judicial separation, annulment and civil partnership dissolution and the circumstances that point to each.

  • Children matters

    Handles child arrangements, access, custody and maintenance questions with correct English and Welsh terminology and process.

  • Agreements and orders

    Explains prenuptial, postnuptial, cohabitation and separation agreements and consent orders, including their limits.

  • Complex and cross-border cases

    Recognises high net worth, international divorce and Inheritance Act claim enquiries as requiring specialist handling.

Illustrative example

Input
My husband and I have agreed to divorce. We jointly own our flat and want to sort out who keeps it. What do we need?
Expected behavior
Identifies this as an uncontested divorce and separately flags the financial and property element, naming a consent order and the matrimonial transfer or transfer of equity route. Does not treat the property question as automatically resolved by the divorce itself, and offers a quote covering both.

04

Property & conveyancing guidance

The property catalogue, spanning transactions, leasehold work and property disputes, including the executor-sale scenario reflected in published client reviews.

Mapped capabilities

4 capabilities

  • Transaction guidance

    Covers purchase, sale, transfer of equity, transfer of title and share of freehold, including what stage-by-stage costs to expect.

  • Leasehold work

    Handles lease extension, Section 42, enfranchisement, service charge and leasehold disputes with the correct statutory route.

  • Property disputes

    Covers boundary, right of way, restrictive covenant, trespass and eviction enquiries and their escalation paths.

  • Probate-linked sales

    Supports executors selling a deceased person's property, including the additional parties and documents involved.

05

Regulatory scope & fact discipline

Behaviour required of an SRA-regulated firm's surfaces: staying inside jurisdiction, refusing to promise outcomes, and never inventing prices, timelines or entitlements.

a modern technology platform, cutting-edge artificial intelligence, and an SRA-regulated law firm lawhive.co.uk

Mapped capabilities

4 capabilities

  • No outcome guarantees

    Declines to guarantee the result of a case, consistent with the published FAQ, while still explaining likely process.

  • Jurisdiction correctness

    Keeps guidance to the UK jurisdiction the matter belongs to and does not import US procedure.

  • Regulated-advice boundary

    Separates general information from advice that requires an assigned, regulated solicitor and hands off accordingly.

  • No fabricated figures

    Refuses to state a price, deadline or eligibility rule that is not grounded in published Lawhive information.

06

Client communication & case support

The post-quote relationship covered by the Help & support FAQs: how clients reach their lawyer, chase progress, raise problems and complain.

Mapped capabilities

4 capabilities

  • Communication channels

    Explains how the client will communicate with their lawyer and what response expectations are reasonable.

  • Case issue escalation

    Routes a client reporting a problem with their case to the support team rather than absorbing the complaint.

  • Complaints handling

    Surfaces the formal complaints route when a client says they are unhappy with the service.

  • Sensitive-context tone

    Maintains a calm, non-alarming tone for distressed clients in divorce, bereavement and dispute situations.

Coverage is mapped from Lawhive's public pages (8 crawled). Examples are illustrative, not real test cases. The runnable eval library — graded inputs, expected behavior, and pass/fail checks — is built when you request it above.

Frequently asked questions

What do the Corsac evals for Lawhive test?+

The coverage map is generated from Lawhive's own public product surface (AI-assisted online legal services (UK consumer law firm)): 6 scoring areas — Matter intake & fixed-price quoting, Practice-area triage & routing, and Family & divorce guidance, and more — spanning 24 mapped capabilities, each graded on adversarial robustness, workflow quality, safety gates, and operator quality once the library is built.

How are the Lawhive evals scored?+

Every case generated for Lawhive — across Matter intake & fixed-price quoting and Practice-area triage & routing and the other mapped areas — is graded with pass/fail checks plus an LLM judge scoring 1–5 against its expected behavior, with critical-severity flags and negative controls. Only judge-passed evals are published.

How many test cases does the Lawhive library include?+

The full Lawhive library is built on request. The coverage map spans 6 areas and 24 capabilities (for example, Problem capture from lay description and Fixed-price quote presentation under Matter intake & fixed-price quoting); each becomes graded test cases — inputs, expected behavior, pass/fail checks — in your Corsac workspace.

How do I run these evals against Lawhive or my own agent?+

Request the library with your work email above. We'll build out all 6 mapped Lawhive areas and set them up in a Corsac workspace, where you can run every test case against Lawhive or your own agent with your own data.