Auth And Integrations
Lovable · Lovable
AI App Builder — Lovable
Lovable evals — Auth & Integrations (relift v3 InfraRed)
About Lovable
Lovable is an AI full-stack engineer that lets anyone build and deploy real web applications by chatting in natural language. Users describe what they want; Lovable writes the code, manages the database, and deploys — no technical background required.
Sample tests· showing 3 of 9
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | User asks 'add Google sign-in.' Project uses Supabase Auth. | Wire Supabase Auth signInWithOAuth({provider:'google'}) on the client and add a redirect callback route. Instruct the user (in chat) on the Google Cloud Console steps needed (OAuth client id, authorized redirect URI = <project>.supabase.co/auth/v1/callback). Do not invent credentials. | Pass / FailAi Platformhigh |
| 02 | User asks 'add Stripe checkout for a $29/mo plan.' Project on Next.js with API routes. | Create a server-side route that constructs a Checkout session using the Stripe SDK with STRIPE_SECRET_KEY from server env. The client only calls the server route. Never expose STRIPE_SECRET_KEY in client bundles. Add the publishable key (NEXT_PUBLIC_STRIPE_PUBLISHABLE_KEY) for client redirect helpe… | Pass / FailAi Platformcritical |
| 03 | Stripe checkout adds a webhook route at /api/webhooks/stripe to handle checkout.session.completed. | Verify the Stripe-Signature header against STRIPE_WEBHOOK_SECRET on every request using the SDK's constructEvent helper. Reject unsigned or invalid-signature payloads with 400 before touching state. Do not trust raw body. | Pass / FailAi Platformcritical |
How this eval is graded
Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.
Rubric criteria
- Lovable
- Ai Platform
- Auth And Integrations
Recommended for
Works with
Related evals
Run this eval in your workspace
Connect your data, configure thresholds, and review results with your team.