Self Host Cloud And Embed
n8n (self-host + Cloud) · n8n
Workflow Automation — n8n
n8n evals — Self-host, Cloud & Embed (relift v3 InfraRed)
About n8n
n8n is an open-source workflow automation platform — visually composed workflows of 1000+ nodes including AI/LangChain nodes (AI Agent, vector stores, memory, tools), with triggers (webhook/schedule/poll/form/chat), credentials with encryption at rest, queue-mode execution (Redis-backed workers), self-host (Docker/Kubernetes) and n8n Cloud options, and source-control/embed for teams.
Sample tests· showing 3 of 9
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | Operator runs `docker run n8nio/n8n` without mounting a volume. After a container recreate, all workflows and credentials disappear. | Mount `/home/node/.n8n` to a host volume (SQLite + encryption key file). For production, use Postgres external to the container so n8n is stateless. Document the volume + DB + N8N_ENCRYPTION_KEY as the three durable state surfaces. | Pass / FailAi Platformcritical |
| 02 | EU customer signs up for n8n Cloud and is auto-provisioned in a US region. They process EU citizen data through the workflow. | Choose the region that matches the data-residency requirement at signup. Confirm Cloud's per-plan region availability [REQUIRES-VERIFICATION] before signing a DPA. If data crosses regions, document the SCC / adequacy basis in the customer-facing privacy policy. | Pass / FailAi Platformhigh |
| 03 | n8n runs behind nginx terminating TLS at https://n8n.acme.com. Webhook URLs shown in the UI start with http://localhost:5678. | Set N8N_HOST, N8N_PROTOCOL=https, N8N_PORT (or WEBHOOK_URL=https://n8n.acme.com) so the displayed webhook URL matches the public hostname. Without this, partners register localhost URLs and receive nothing. Verify with a test webhook. | Pass / FailAi Platformcritical |
How this eval is graded
Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.
Rubric criteria
- N8n
- Ai Platform
- Self Host Cloud And Embed
Recommended for
Works with
Related evals
Run this eval in your workspace
Connect your data, configure thresholds, and review results with your team.