Qdrant
For QdrantAI Platform

Collections And Configuration

Qdrant · Qdrant

Vector Database — Qdrant

Evaluates Qdrant's Collections & Configuration across 9 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Vector Database eval coverage.

About Qdrant

Qdrant is an open-source vector database and similarity-search engine — collections with configurable vector size/distance, payload filtering (must/should/must_not), named and sparse vectors, hybrid search with prefetch and RRF/DBSF fusion, scalar/product/binary quantization, and the managed Qdrant Cloud with API-key/JWT auth and payload-based multitenancy.

Employees

~80

Industry

Vector Database

Headquarters

Berlin, Germany

Sample tests· showing 3 of 9

#InputExpected behaviorCheck
01

Agent creates a collection via PUT /collections/products with vectors={size:1536, distance:'Cosine'} to store OpenAI text-embedding-3-small vectors.

Set vectors.size to exactly the embedder's output dimension (1536) and distance to the metric the model was trained for (Cosine for normalized OpenAI embeddings). Both are fixed at create time and immutable — verify the embedder dimension before create rather than guessing.

Pass / FailAi Platformcritical
02

A product needs both an image embedding and a text embedding per item. Agent configures vectors as a map {image:{size:512,distance:'Cosine'}, text:{size:768,distance:'Cosine'}}.

Define named vectors as a map at create time; every upsert must supply vectors as a dict keyed by the named-vector names; search/query must specify which named vector via the using parameter. Do not mix a default unnamed vector with named vectors in the same collection.

Pass / FailAi Platformhigh
03

A 50M-point collection exceeds RAM budget. Agent sets vectors.on_disk=true and leaves the HNSW graph in memory.

Set vectors.on_disk=true to store raw vectors via memmap while keeping the HNSW index resident; expect higher tail latency on rescore reads. Pair with quantization always_ram if low-latency first-stage search is required. Verify memory accounting against the documented storage layout.

Pass / FailAi Platformhigh

Unlock full benchmark

6 more test cases

Use this benchmark

How this eval is graded

Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.

Rubric criteria

  • Qdrant
  • Ai Platform
  • Collections And Configuration

Recommended for

QdrantQdrant customers

Works with

Related evals

Frequently asked questions

What does the Collections And Configuration eval for Qdrant Qdrant test?+

Evaluates Qdrant's Collections & Configuration across 9 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Vector Database eval coverage.

How is the Collections And Configuration eval scored?+

The judge rubric: Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.

How many test cases does this eval pack include?+

The Collections And Configuration pack for Qdrant Qdrant contains 9 test cases. 3 sample cases are shown free on this page; the full set runs in a Corsac workspace.

How do I run this eval?+

Sign up for Corsac, connect your model or agent endpoint, and run the Collections And Configuration pack as-is or after customizing thresholds. Results land in your workspace with per-case scores, and you can gate releases on the pack in CI via the REST API.

Run this eval in your workspace

Connect your data, configure thresholds, and review results with your team.