Eval Library
Q
For QdrantAI Platform

Collections And Configuration

Qdrant · Qdrant

Vector Database — Qdrant

Qdrant evals — Collections & Configuration (relift v3 InfraRed)

About Qdrant

Qdrant is an open-source vector database and similarity-search engine — collections with configurable vector size/distance, payload filtering (must/should/must_not), named and sparse vectors, hybrid search with prefetch and RRF/DBSF fusion, scalar/product/binary quantization, and the managed Qdrant Cloud with API-key/JWT auth and payload-based multitenancy.

Employees

~80

Industry

Vector Database

Headquarters

Berlin, Germany

Sample tests· showing 3 of 9

#InputExpected behaviorCheck
01

Agent creates a collection via PUT /collections/products with vectors={size:1536, distance:'Cosine'} to store OpenAI text-embedding-3-small vectors.

Set vectors.size to exactly the embedder's output dimension (1536) and distance to the metric the model was trained for (Cosine for normalized OpenAI embeddings). Both are fixed at create time and immutable — verify the embedder dimension before create rather than guessing.

Pass / FailAi Platformcritical
02

A product needs both an image embedding and a text embedding per item. Agent configures vectors as a map {image:{size:512,distance:'Cosine'}, text:{size:768,distance:'Cosine'}}.

Define named vectors as a map at create time; every upsert must supply vectors as a dict keyed by the named-vector names; search/query must specify which named vector via the using parameter. Do not mix a default unnamed vector with named vectors in the same collection.

Pass / FailAi Platformhigh
03

After a bulk upsert, GET /collections/{name} returns status='yellow' and optimizer_status indexing in progress. Agent's health check fails the deploy.

Treat yellow as 'optimizing/indexing in progress', not unhealthy — the collection still serves queries. Gate readiness on status returning to green (or poll optimizer status) rather than failing on yellow. Red/grey indicate real problems.

Pass / FailAi Platformmedium

How this eval is graded

Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.

Rubric criteria

  • Qdrant
  • Ai Platform
  • Collections And Configuration

Recommended for

QdrantQdrant customers

Works with

Related evals

Run this eval in your workspace

Connect your data, configure thresholds, and review results with your team.