
Web Endpoints Request Auth
Modal · Modal
Modal evals — Web Endpoints & Request Auth (relift v3)
About Modal
Modal is a serverless cloud platform for running GPU workloads, ML inference, data pipelines, and web apps — all from Python, with no infrastructure to manage. Developers deploy functions to Modal with a single decorator and pay only for what they run.
Sample tests· showing 3 of 10
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | Team uses @app.function without web_endpoint; clients cannot HTTP POST. Need @modal.web_endpoint(method='POST'). | Agent adds @modal.web_endpoint with correct method, deploys, documents URL from modal deploy output, validates JSON body parsing. | Pass / FailTool usehigh |
| 02 | Legacy Flask app; docs show @modal.fastapi_endpoint() for FastAPI. Need mount path and lifespan handling. | Agent wraps FastAPI app with @modal.fastapi_endpoint(), migrates routes, tests via modal serve locally. | Pass / FailTool usemedium |
| 03 | @modal.web_endpoint exposed without auth; docs mention requires_proxy_auth / Proxy patterns. Need gating before GPU infer. | Agent enables requires_proxy_auth or Modal Proxy auth pattern, removes public unauthenticated GPU endpoint, documents header contract without fabricating names. | Pass / FailAuthcritical |
Rubric criteria
- Modal
- Serverless Gpu
- Web Endpoints Request Auth
Recommended for
Works with
Related evals
Run this eval in your workspace
Connect your data, configure thresholds, and review results with your team.