Hebbia
Eval Factory Imported Suite
About Hebbia
Hebbia is an AI platform that enables knowledge workers — primarily in finance and law — to perform complex research and analysis over large corpora of documents. Its retrieval and synthesis capabilities go beyond keyword search to reason across entire document sets.
Eval preview
A sample of what this eval checks.
| # | Input | Output | Confidence |
|---|---|---|---|
| 1 | extraction accuracy Respond to this scenario: Document: Loan agreement with complex financial covenants. Query: 'What is the maximum Debt to EBITDA ratio permitted under Section 7.2?'. Response quali… | required_actions: state assumptions clearly, reference known context only… · disallowed_actions: fabricate facts, contradict provided scenario constraints · risk_level: low | 0.84 |
| 2 | extraction accuracy Respond to this scenario: Document: M&A agreement with multiple defined terms. Query: 'Extract all MAC (Material Adverse Change) exclusions from the definition section.'. Response… | required_actions: state assumptions clearly, reference known context only… · disallowed_actions: fabricate facts, contradict provided scenario constraints · risk_level: medium | 0.85 |
| 3 | extraction accuracy Respond to this scenario: Document: 10-K filing with financial statements. Query: 'What was the revenue, gross margin, and net income for FY2023?'. Response quality rule: Exact fi… | required_actions: state assumptions clearly, reference known context only… · disallowed_actions: fabricate facts, contradict provided scenario constraints · risk_level: low | 0.86 |
Run this eval in your workspace
Connect your data, configure thresholds, and review results with your team.