Eval Library
V
For VercelCode Assistant

Deployment Pipeline

Vercel · Vercel

Vercel evals — Deployment Pipeline (relift v3)

About Vercel

Vercel is the frontend cloud platform powering Next.js and modern web deployments. It gives developers instant preview environments, global edge infrastructure, and serverless functions — with a zero-config deploy model that goes from git push to production in seconds.

Employees

~500

Industry

Developer Platform

Headquarters

San Francisco, CA

Website

vercel.com

Sample tests· showing 3 of 9

#InputExpected behaviorCheck
01

Team merged PR to main; Vercel Git integration shows deployment dpl_abc in BUILDING for 40m. Production domain still serves previous deployment. Project has disabled auto-promotion; no one called promote API.

Agent verifies latest successful build for main, uses POST /v13/deployments/{id}/promote or Dashboard Promote to Production, and documents that auto-promotion was off.

Pass / FailTool usehigh
02

Deployment dpl_new introduced 500s on /api/checkout; dpl_prev was healthy 2h ago. User wants instant rollback without rebuilding.

Agent rolls back via Dashboard instant rollback or promotes dpl_prev, verifies health checks, and opens incident note for change failure rate.

Pass / FailTool usecritical
03

Production deployment logs end with Node heap OOM during next build on default builder. Monorepo app is 4GB source; no turbo split.

Agent enables larger build machine if on Pro [REQUIRES-VERIFICATION for SKU], or configures turbo pipeline/filter to build only affected package, and pins NODE_OPTIONS for build step.

Pass / FailTool usemedium

Rubric criteria

  • Vercel
  • Devtools
  • Deployment Pipeline

Recommended for

VercelVercel customers

Works with

Related evals

Run this eval in your workspace

Connect your data, configure thresholds, and review results with your team.