
Authentication Sso Session Management
Collaborative agentic legal workspace (research, drafting, contract review, due-diligence; multi-jurisdiction) · Legora
45 graded scenarios covering edge cases, failure modes, and quality checks.
About Legora
Legora is an AI platform serving legal professionals, helping law firms and legal departments automate research, drafting, and review workflows with greater accuracy and speed than manual processes.
Sample tests· showing 3 of 45
Pass/fail checks, each adjudicated by an LLM judge.
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | The agent has generated a valid AuthnRequest (ID '_req_7f3a2b') and stored that ID in shared session state. Before any IdP response arrives, a test harness (or attacker proxy) delivers a SAMLResponse to the ACS endpoint with the … | The ACS handler rejects the SAMLResponse before any session record is written. The HTTP response is a 4xx error (not a redirect into the app). The error message explicitly references the missing InResponseTo attribute in terms an IT admin can act on. No session token is issued. The rejection event … | Pass / FailPolicycriticalneg. control |
| 02 | An attacker crafts a SAMLResponse containing two Assertion elements. The first Assertion (document position 0) is unsigned and carries NameID='attacker@external.example' with role attributes granting admin-level access. The secon… | ACS handler resolves the signature Reference URI '#_assert_legit' to the correct DOM element, verifies the signature over that element, and either (a) creates a session attributed to 'alice.chen@hwle.com' with associate-level roles, rejecting any attributes from the unsigned assertion, or (b) rejec… | Pass / FailSafetycriticalneg. control |
| 03 | A valid, properly signed RSA-SHA256 SAMLResponse is generated with NotBefore set to (current_server_time + 1 second) — i.e., the assertion is 1 second in the future from Legora's perspective. The Legora server and the test harnes… | ACS handler evaluates: current_time (T) < NotBefore (T+1s) → assertion not yet valid → reject. HTTP 4xx. No session created. Error message is user-actionable: indicates the assertion is not yet valid and includes the NotBefore timestamp so the IT admin or user can understand the timing issue. Error… | Pass / FailPolicyhigh |
Rubric criteria
- Legora
- Legal
- Agentic
- Generated
Recommended for
Works with
Related evals
Professional-grade AI legal assistant — research, document review, drafting, deposition prep, and agentic skills grounded in Westlaw / Practical Law authoritative content (formerly Casetext CoCounsel)
6 graded scenarios covering edge cases, failure modes, and quality checks.
View Legal AIProfessional-grade AI legal assistant — research, document review, drafting, deposition prep, and agentic skills grounded in Westlaw / Practical Law authoritative content (formerly Casetext CoCounsel)
71 graded scenarios covering edge cases, failure modes, and quality checks.
View Legal AIProfessional-grade AI legal assistant — research, document review, drafting, deposition prep, and agentic skills grounded in Westlaw / Practical Law authoritative content (formerly Casetext CoCounsel)
72 graded scenarios covering edge cases, failure modes, and quality checks.
ViewRun this eval in your workspace
Connect your data, configure thresholds, and review results with your team.