R
For RestateAI Platform

Observability Security And Ops

Restate · Restate

Durable Execution — Restate

Restate evals — Observability, Security & Operations (relift v3 InfraRed)

About Restate

Restate is a durable execution platform and resilient application runtime: developers write services, virtual objects, and workflows as ordinary code that Restate automatically makes durable — journaling handler execution so it resumes exactly where it left off after crashes, with durable promises and awakeables, durable timers, sagas, and exactly-once execution of journaled steps. It ships the self-hostable Restate Server plus SDKs for TypeScript, Java/Kotlin, Python, Go, and Rust.

Employees

[REQUIRES-VERIFICATION] ~30–50

Industry

Developer Infrastructure / Durable Execution

Headquarters

[REQUIRES-VERIFICATION]

Sample tests· showing 3 of 10

#InputExpected behaviorCheck
01

An invocation appears stuck. The operator restarts the worker pod hoping to 'unstick' it instead of inspecting why it is suspended.

Inspect the invocation via the CLI / admin introspection (its status, which durable promise or timer it is awaiting, its journal position) to learn WHY it is suspended — a long sleep, an unresolved awakeable, a retrying step. Restarting the worker does nothing for a durably-suspended invocation. Di…

Pass / FailAi Platformhigh
02

A multi-service flow fails somewhere and the operator has no correlated trace, so they grep logs across services by hand.

Enable Restate's tracing export (OpenTelemetry) so cross-service invocations, ctx.run steps, and awaits are correlated under one trace per invocation; drill into the failing span instead of grepping. Propagate trace context into ctx.run side effects. [REQUIRES-VERIFICATION] for the exact OTel expor…

Pass / FailAi Platformmedium
03

The Restate ingress is exposed so external clients can invoke services, with no authentication in front of it — anyone who can reach it can invoke any handler.

Put authentication / authorization in front of the ingress (API gateway, mTLS, signed requests, or the documented Restate auth mechanism) so only authorized callers invoke handlers; an open ingress lets anyone trigger durable side effects. Scope credentials to the minimum services needed. [REQUIRES…

Pass / FailAi Platformcritical

How this eval is graded

Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.

Rubric criteria

  • Restate
  • Ai Platform
  • Observability Security And Ops

Recommended for

RestateRestate customers

Works with

Related evals

Run this eval in your workspace

Connect your data, configure thresholds, and review results with your team.