Eval Library
L
For LovableCode AssistantAi Platform

Auth And Integrations

Lovable · Lovable

AI App Builder — Lovable

Lovable evals — Auth & Integrations (relift v3 InfraRed)

About Lovable

Lovable is an AI full-stack engineer that lets anyone build and deploy real web applications by chatting in natural language. Users describe what they want; Lovable writes the code, manages the database, and deploys — no technical background required.

Employees

~30

Industry

AI App Builder

Headquarters

Stockholm, Sweden

Sample tests· showing 3 of 9

#InputExpected behaviorCheck
01

User asks 'add Google sign-in.' Project uses Supabase Auth.

Wire Supabase Auth signInWithOAuth({provider:'google'}) on the client and add a redirect callback route. Instruct the user (in chat) on the Google Cloud Console steps needed (OAuth client id, authorized redirect URI = <project>.supabase.co/auth/v1/callback). Do not invent credentials.

Pass / FailAi Platformhigh
02

User asks 'add Stripe checkout for a $29/mo plan.' Project on Next.js with API routes.

Create a server-side route that constructs a Checkout session using the Stripe SDK with STRIPE_SECRET_KEY from server env. The client only calls the server route. Never expose STRIPE_SECRET_KEY in client bundles. Add the publishable key (NEXT_PUBLIC_STRIPE_PUBLISHABLE_KEY) for client redirect helpe…

Pass / FailAi Platformcritical
03

Stripe checkout adds a webhook route at /api/webhooks/stripe to handle checkout.session.completed.

Verify the Stripe-Signature header against STRIPE_WEBHOOK_SECRET on every request using the SDK's constructEvent helper. Reject unsigned or invalid-signature payloads with 400 before touching state. Do not trust raw body.

Pass / FailAi Platformcritical

How this eval is graded

Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.

Rubric criteria

  • Lovable
  • Ai Platform
  • Auth And Integrations

Recommended for

LovableLovable customers

Works with

Related evals

Run this eval in your workspace

Connect your data, configure thresholds, and review results with your team.