Replit Db And Storage
Replit Agent · Replit
Autonomous Coding Agent — Replit Agent
Evaluates Replit's Replit DB & Storage across 9 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Autonomous Coding Agent eval coverage.
About Replit
Replit is a browser-based collaborative coding platform; Replit Agent is its autonomous coding agent that turns a prompt into an app plan and builds, iterates, and deploys the full application inside a Repl — wiring Replit Auth, Replit DB, Object Storage, and Autoscale / Reserved VM / Static / Scheduled Deployments, all under a checkpoint-based cost meter.
Employees
~150
Industry
Online IDE & Autonomous Coding Agent
Headquarters
San Francisco, CA
Website
replit.comSample tests· showing 3 of 9
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | App stores per-user todos. Agent uses raw user input ('alice') as the Replit DB key without a prefix. | Prefix keys with a stable namespace (`todos:alice:<uuid>`) so per-user data is enumerable via `db.prefix('todos:alice:')` and collisions with other entities (`users:alice`, `sessions:alice`) are impossible. Document the schema in a README. | Pass / FailCode Assistanthigh |
| 02 | Agent stores a Python `datetime` object directly: `db['created'] = datetime.now()`. Replit DB JSON-serializes values. | Serialize non-JSON-native types explicitly (e.g., ISO 8601 string for datetime). On read, parse back. The `replit` Python client JSON-serializes values; relying on implicit coercion of datetime is undefined. | Pass / FailCode Assistantmedium |
| 03 | App uploads user avatars. Agent must bind an Object Storage bucket to the Repl and use the @replit/object-storage SDK. | Create or select a bucket in the workspace Object Storage panel, bind it to the Repl (the SDK reads the binding from the runtime), and call `client.uploadFromBytes(...)` with a stable object key. Do not hardcode bucket credentials — they're injected via the binding. | Pass / FailCode Assistantcritical |
How this eval is graded
Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.
Rubric criteria
- Replit
- Code Assistant
- Replit Db And Storage
Recommended for
Works with
Related evals
Browserbase
Evaluates Browserbase's Captcha Handling across scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Browser infrastructure eval coverage.
View Code AssistantBrowserbase
Evaluates Browserbase's Concurrency & Rate Limits across scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Browser infrastructure eval coverage.
View Code AssistantBrowserbase
Evaluates Browserbase's Live Debugging & Session Inspector across scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Browser infrastructure eval coverage.
ViewFrequently asked questions
What does the Replit Db And Storage eval for Replit Replit Agent test?+
Evaluates Replit's Replit DB & Storage across 9 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Autonomous Coding Agent eval coverage.
How is the Replit Db And Storage eval scored?+
The judge rubric: Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.
How many test cases does this eval pack include?+
The Replit Db And Storage pack for Replit Replit Agent contains 9 test cases. 3 sample cases are shown free on this page; the full set runs in a Corsac workspace.
How do I run this eval?+
Sign up for Corsac, connect your model or agent endpoint, and run the Replit Db And Storage pack as-is or after customizing thresholds. Results land in your workspace with per-case scores, and you can gate releases on the pack in CI via the REST API.
Run this eval in your workspace
Connect your data, configure thresholds, and review results with your team.