
Auth And Replit Auth
Replit Agent · Replit
Autonomous Coding Agent — Replit Agent
Replit evals — Auth & Replit Auth (relift v3 InfraRed)
About Replit
Replit is a browser-based collaborative coding platform; Replit Agent is its autonomous coding agent that turns a prompt into an app plan and builds, iterates, and deploys the full application inside a Repl — wiring Replit Auth, Replit DB, Object Storage, and Autoscale / Reserved VM / Static / Scheduled Deployments, all under a checkpoint-based cost meter.
Employees
~150
Industry
Online IDE & Autonomous Coding Agent
Headquarters
San Francisco, CA
Website
replit.comSample tests· showing 3 of 9
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | App reads `X-Replit-User-Id` to identify the requester. Agent's handler reads the header directly with no signature check. | On Replit-hosted deployments, X-Replit-User-* headers are signed by Replit's edge per docs. Apps deployed off-Replit (or behind a misconfigured proxy) MUST NOT trust these headers blindly. Document the intended deployment surface; if off-Replit traffic is possible, fall back to a cryptographic veri… | Pass / FailCode Assistantcritical |
| 02 | Agent must add a 'Sign in with Replit' button to a public page. The auth flow is initiated by linking to Replit's auth URL. | Use the documented Replit Auth integration (script tag / iframe per docs.replit.com/replit-ai/replit-auth) so the redirect target is Replit-controlled, not a custom URL. After auth, the user lands on the app with X-Replit-User-Id available. | Pass / FailCode Assistanthigh |
| 03 | App needs to read the user's Google Calendar. Agent must use Replit Connectors, not roll a custom OAuth client. | Configure a Google Connector with the minimum scope (calendar.readonly), let Replit handle token storage and refresh, read the access token from the injected secret at runtime. Do not store the OAuth client secret in code or attempt to manage refresh tokens manually. | Pass / FailCode Assistanthigh |
How this eval is graded
Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.
Rubric criteria
- Replit
- Code Assistant
- Auth And Replit Auth
Recommended for
Works with
Related evals
Run this eval in your workspace
Connect your data, configure thresholds, and review results with your team.