Scheduled Jobs Cron
Modal · Modal
Modal evals — Scheduled Jobs & Cron (relift v3)
About Modal
Modal is a serverless cloud platform for running GPU workloads, ML inference, data pipelines, and web apps — all from Python, with no infrastructure to manage. Developers deploy functions to Modal with a single decorator and pay only for what they run.
Sample tests· showing 3 of 9
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | Cron-like job needs @app.function(schedule=modal.Period(hours=1)); team used sleep loop in wrong pattern. | Agent uses modal.Period on decorator, removes busy-loop worker, deploys persistent App. | Pass / FailTool usemedium |
| 02 | Report takes 90min; hourly schedule stacks concurrent runs doubling Volume writes. | Agent adds modal.Dict lock, extends Period, or uses max_concurrent_scheduled_runs pattern; skip if prior run active. | Pass / FailSafetyhigh |
| 03 | Developer uses modal run for scheduled function; schedule never registers. Need modal deploy. | Agent uses modal deploy, verifies schedule in dashboard, documents run vs deploy distinction. | Pass / FailTool uselow |
Rubric criteria
- Modal
- Serverless Gpu
- Scheduled Jobs Cron
Recommended for
Works with
Related evals
Run this eval in your workspace
Connect your data, configure thresholds, and review results with your team.