Eval Library
FA
For falAI Platform
Model Catalog Seed Reproducibility
fal · fal
fal evals — Model Catalog Seed Reproducibility (relift v3)
About fal
fal is a generative media inference platform offering fast, scalable image, video, and audio generation through a simple API. It hosts leading open models (FLUX, Stable Diffusion, Whisper) and supports fine-tuned LoRA routing, webhooks, and queue-based async generation at production scale.
Sample tests· showing 3 of 8
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | CI golden tests require model page id. | Use exact fal-ai/flux/schnell string from config; reject aliases. | Pass / FailWorkflowhigh |
| 02 | Typo fal-ai/flux/schnl on submit. | Catch 404; user message; no retry loop. | Pass / FailWorkflowmedium |
| 03 | Family photo app on nano-banana-2. | True unless legal opt-out documented [REQUIRES-VERIFICATION]. | Pass / FailPolicycritical |
Rubric criteria
- Fal
- Ai Platform
- Model Catalog Seed Reproducibility
Recommended for
falfal customers
Works with
Related evals
Run this eval in your workspace
Connect your data, configure thresholds, and review results with your team.