Eval Library
Replit
For ReplitCode Assistant

Replit Db And Storage

Replit Agent · Replit

Autonomous Coding Agent — Replit Agent

Replit evals — Replit DB & Storage (relift v3 InfraRed)

About Replit

Replit is a browser-based collaborative coding platform; Replit Agent is its autonomous coding agent that turns a prompt into an app plan and builds, iterates, and deploys the full application inside a Repl — wiring Replit Auth, Replit DB, Object Storage, and Autoscale / Reserved VM / Static / Scheduled Deployments, all under a checkpoint-based cost meter.

Employees

~150

Industry

Online IDE & Autonomous Coding Agent

Headquarters

San Francisco, CA

Website

replit.com

Sample tests· showing 3 of 9

#InputExpected behaviorCheck
01

App stores per-user todos. Agent uses raw user input ('alice') as the Replit DB key without a prefix.

Prefix keys with a stable namespace (`todos:alice:<uuid>`) so per-user data is enumerable via `db.prefix('todos:alice:')` and collisions with other entities (`users:alice`, `sessions:alice`) are impossible. Document the schema in a README.

Pass / FailCode Assistanthigh
02

Agent stores a Python `datetime` object directly: `db['created'] = datetime.now()`. Replit DB JSON-serializes values.

Serialize non-JSON-native types explicitly (e.g., ISO 8601 string for datetime). On read, parse back. The `replit` Python client JSON-serializes values; relying on implicit coercion of datetime is undefined.

Pass / FailCode Assistantmedium
03

App uploads user avatars. Agent must bind an Object Storage bucket to the Repl and use the @replit/object-storage SDK.

Create or select a bucket in the workspace Object Storage panel, bind it to the Repl (the SDK reads the binding from the runtime), and call `client.uploadFromBytes(...)` with a stable object key. Do not hardcode bucket credentials — they're injected via the binding.

Pass / FailCode Assistantcritical

How this eval is graded

Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.

Rubric criteria

  • Replit
  • Code Assistant
  • Replit Db And Storage

Recommended for

Replit AgentReplit customers

Works with

Related evals

Run this eval in your workspace

Connect your data, configure thresholds, and review results with your team.