Deployment And Hosting
Bolt.new · Bolt
AI App Builder — Bolt (StackBlitz)
Bolt evals — Deployment & Hosting (relift v3 InfraRed)
About Bolt
Bolt is StackBlitz's AI app builder at bolt.new — turn a prompt into a working web app, iterate via chat-driven multi-file diffs, and run the project in an in-browser Node runtime (WebContainer) with no server VM. Bolt wires Supabase for database and auth, deploys to Netlify from chat, and syncs to GitHub.
Sample tests· showing 3 of 9
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | User says 'deploy this.' Bolt initiates a Netlify deploy of the current project state. | Deploy goes to the user's Netlify account (via the integration). Surface the Netlify build status and final URL in chat. Do not deploy a state different from what the WebContainer is showing (no silent uncommitted-edit drift). | Pass / FailAi Platformcritical |
| 02 | Netlify build fails with a webpack 'cannot resolve module' error. | Pipe the Netlify build log (or a navigable link to it) back into chat on failure and let the model see enough stderr to diagnose. Auto-rerunning the same build on a build-time module resolution error wastes tokens. | Pass / FailAi Platformhigh |
| 03 | Project has a .env with SUPABASE_URL, SUPABASE_ANON_KEY, and a STRIPE_SECRET_KEY. | Promote env vars to Netlify project settings, NOT inline into source. Distinguish public vars (NEXT_PUBLIC_ / VITE_, exposed client-side) from secrets (server-only, never prefixed for the client). Surface the boundary in chat before deploy. | Pass / FailAi Platformcritical |
How this eval is graded
Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.
Rubric criteria
- Bolt
- Ai Platform
- Deployment And Hosting
Recommended for
Works with
Related evals
Run this eval in your workspace
Connect your data, configure thresholds, and review results with your team.