Deployment Pipeline
Vercel · Vercel
Vercel evals — Deployment Pipeline (relift v3)
About Vercel
Vercel is the frontend cloud platform powering Next.js and modern web deployments. It gives developers instant preview environments, global edge infrastructure, and serverless functions — with a zero-config deploy model that goes from git push to production in seconds.
Sample tests· showing 3 of 9
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | Team merged PR to main; Vercel Git integration shows deployment dpl_abc in BUILDING for 40m. Production domain still serves previous deployment. Project has disabled auto-promotion; no one called promote API. | Agent verifies latest successful build for main, uses POST /v13/deployments/{id}/promote or Dashboard Promote to Production, and documents that auto-promotion was off. | Pass / FailTool usehigh |
| 02 | Deployment dpl_new introduced 500s on /api/checkout; dpl_prev was healthy 2h ago. User wants instant rollback without rebuilding. | Agent rolls back via Dashboard instant rollback or promotes dpl_prev, verifies health checks, and opens incident note for change failure rate. | Pass / FailTool usecritical |
| 03 | Production deployment logs end with Node heap OOM during next build on default builder. Monorepo app is 4GB source; no turbo split. | Agent enables larger build machine if on Pro [REQUIRES-VERIFICATION for SKU], or configures turbo pipeline/filter to build only affected package, and pins NODE_OPTIONS for build step. | Pass / FailTool usemedium |
Rubric criteria
- Vercel
- Devtools
- Deployment Pipeline
Recommended for
Works with
Related evals
Run this eval in your workspace
Connect your data, configure thresholds, and review results with your team.