
Strategies
Unstructured (API + Platform) · Unstructured
Document ETL for LLMs — Unstructured (API + Platform)
Evaluates Unstructured's Strategies across 9 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Document ETL for LLMs eval coverage.
About Unstructured
Unstructured turns unstructured documents (PDFs, Office files, HTML, images, email) into clean, structured, LLM-ready data — partitioning into typed elements, table/layout extraction, chunking, embedding, and a Platform with source/destination connectors. Developers use the Unstructured API and Platform to build the document ETL layer for RAG and agent pipelines.
Sample tests· showing 3 of 9
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | Operator sets strategy=auto for a mixed corpus of clean digital PDFs and scanned images, expecting Unstructured to pick per document. | auto routes per document/page between text extraction and OCR/layout. Use auto when the corpus is heterogeneous; do not assume auto always equals hi_res or always equals fast — verify behavior by inspecting which elements carry coordinates (layout) vs plain text. | Pass / FailAi Platformmedium |
| 02 | To cut cost the agent forces strategy=fast for every document, including scanned invoices and image-only PDFs. | fast is text-only (no OCR, no layout model) — it works for born-digital docs but yields empty/garbled output on scans. Reserve fast for documents with an embedded text layer; route image/scanned docs to hi_res or ocr_only. | Pass / FailAi Platformhigh |
| 03 | A document with multi-column layout, figures, and tables must be extracted with accurate element typing and table structure. | Use strategy=hi_res so the layout-detection model assigns element types, table structure (with infer_table_structure), and coordinates. Accept that hi_res is slower/costlier than fast — the tradeoff buys layout fidelity the workload requires. | Pass / FailAi Platformhigh |
How this eval is graded
Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.
Rubric criteria
- Unstructured
- Ai Platform
- Strategies
Recommended for
Works with
Related evals
Claude API
Evaluates Anthropic's Batch API across 9 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Foundation Model & API eval coverage.
View AI PlatformClaude API
Evaluates Anthropic's Extended Thinking across 9 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Foundation Model & API eval coverage.
View AI PlatformClaude API
Evaluates Anthropic's Files API & Citations across 9 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Foundation Model & API eval coverage.
ViewFrequently asked questions
What does the Strategies eval for Unstructured Unstructured (API + Platform) test?+
Evaluates Unstructured's Strategies across 9 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Document ETL for LLMs eval coverage.
How is the Strategies eval scored?+
The judge rubric: Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.
How many test cases does this eval pack include?+
The Strategies pack for Unstructured Unstructured (API + Platform) contains 9 test cases. 3 sample cases are shown free on this page; the full set runs in a Corsac workspace.
How do I run this eval?+
Sign up for Corsac, connect your model or agent endpoint, and run the Strategies pack as-is or after customizing thresholds. Results land in your workspace with per-case scores, and you can gate releases on the pack in CI via the REST API.
Run this eval in your workspace
Connect your data, configure thresholds, and review results with your team.