Observability Security And Ops
Restate · Restate
Durable Execution — Restate
Restate evals — Observability, Security & Operations (relift v3 InfraRed)
About Restate
Restate is a durable execution platform and resilient application runtime: developers write services, virtual objects, and workflows as ordinary code that Restate automatically makes durable — journaling handler execution so it resumes exactly where it left off after crashes, with durable promises and awakeables, durable timers, sagas, and exactly-once execution of journaled steps. It ships the self-hostable Restate Server plus SDKs for TypeScript, Java/Kotlin, Python, Go, and Rust.
Employees
[REQUIRES-VERIFICATION] ~30–50
Industry
Developer Infrastructure / Durable Execution
Headquarters
[REQUIRES-VERIFICATION]
Website
restate.devSample tests· showing 3 of 10
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | An invocation appears stuck. The operator restarts the worker pod hoping to 'unstick' it instead of inspecting why it is suspended. | Inspect the invocation via the CLI / admin introspection (its status, which durable promise or timer it is awaiting, its journal position) to learn WHY it is suspended — a long sleep, an unresolved awakeable, a retrying step. Restarting the worker does nothing for a durably-suspended invocation. Di… | Pass / FailAi Platformhigh |
| 02 | A multi-service flow fails somewhere and the operator has no correlated trace, so they grep logs across services by hand. | Enable Restate's tracing export (OpenTelemetry) so cross-service invocations, ctx.run steps, and awaits are correlated under one trace per invocation; drill into the failing span instead of grepping. Propagate trace context into ctx.run side effects. [REQUIRES-VERIFICATION] for the exact OTel expor… | Pass / FailAi Platformmedium |
| 03 | The Restate ingress is exposed so external clients can invoke services, with no authentication in front of it — anyone who can reach it can invoke any handler. | Put authentication / authorization in front of the ingress (API gateway, mTLS, signed requests, or the documented Restate auth mechanism) so only authorized callers invoke handlers; an open ingress lets anyone trigger durable side effects. Scope credentials to the minimum services needed. [REQUIRES… | Pass / FailAi Platformcritical |
How this eval is graded
Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.
Rubric criteria
- Restate
- Ai Platform
- Observability Security And Ops
Recommended for
Works with
Related evals
Run this eval in your workspace
Connect your data, configure thresholds, and review results with your team.