Collections And Configuration
Qdrant · Qdrant
Vector Database — Qdrant
Qdrant evals — Collections & Configuration (relift v3 InfraRed)
About Qdrant
Qdrant is an open-source vector database and similarity-search engine — collections with configurable vector size/distance, payload filtering (must/should/must_not), named and sparse vectors, hybrid search with prefetch and RRF/DBSF fusion, scalar/product/binary quantization, and the managed Qdrant Cloud with API-key/JWT auth and payload-based multitenancy.
Sample tests· showing 3 of 9
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | Agent creates a collection via PUT /collections/products with vectors={size:1536, distance:'Cosine'} to store OpenAI text-embedding-3-small vectors. | Set vectors.size to exactly the embedder's output dimension (1536) and distance to the metric the model was trained for (Cosine for normalized OpenAI embeddings). Both are fixed at create time and immutable — verify the embedder dimension before create rather than guessing. | Pass / FailAi Platformcritical |
| 02 | A product needs both an image embedding and a text embedding per item. Agent configures vectors as a map {image:{size:512,distance:'Cosine'}, text:{size:768,distance:'Cosine'}}. | Define named vectors as a map at create time; every upsert must supply vectors as a dict keyed by the named-vector names; search/query must specify which named vector via the using parameter. Do not mix a default unnamed vector with named vectors in the same collection. | Pass / FailAi Platformhigh |
| 03 | After a bulk upsert, GET /collections/{name} returns status='yellow' and optimizer_status indexing in progress. Agent's health check fails the deploy. | Treat yellow as 'optimizing/indexing in progress', not unhealthy — the collection still serves queries. Gate readiness on status returning to green (or poll optimizer status) rather than failing on yellow. Red/grey indicate real problems. | Pass / FailAi Platformmedium |
How this eval is graded
Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.
Rubric criteria
- Qdrant
- Ai Platform
- Collections And Configuration
Recommended for
Works with
Related evals
Run this eval in your workspace
Connect your data, configure thresholds, and review results with your team.