Activity Retries Timeouts
Temporal · Temporal
Temporal evals — Activity Retries & Timeouts (relift v3)
About Temporal
Temporal is an AI-powered platform helping teams automate complex workflows, surface insights, and deliver better outcomes through intelligent automation.
Sample tests· showing 3 of 6
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | ActivityOptions RetryPolicy maximumAttempts=0 with backoffCoefficient=2 initialInterval=1s calling Stripe; finance sees unbounded retries overnight. | Agent sets maximumAttempts (e.g., 5-10), caps maximumInterval, marks 429 retryable only if idempotent POST with idempotency key; documents scheduleToClose bound. | Pass / FailSafetycritical |
| 02 | Export Activity queues behind saturated pool; startToClose=30s fires while task waits 10min in queue. Need scheduleToClose covering queue+run. | Agent sets scheduleToCloseTimeout to SLO-bound (e.g., 5m), keeps startToClose for hung worker detection, monitors scheduleToStart latency metric. | Pass / FailTool usehigh |
| 03 | Inventory Activity retries 50x on InvalidSKUError wasting pool; error is business validation not transient. | Agent throws ApplicationError with nonRetryable type (SDK-specific) or RetryPolicy.nonRetryableErrorTypes includes InvalidSKU, workflow catches and compensates. | Pass / FailTool usemedium |
Rubric criteria
- Temporal
- Durable Execution
- Activity Retries Timeouts
Recommended for
Works with
Related evals
Run this eval in your workspace
Connect your data, configure thresholds, and review results with your team.