Triggers
n8n (self-host + Cloud) · n8n
Workflow Automation — n8n
Evaluates n8n's Triggers across 9 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Workflow Automation eval coverage.
About n8n
n8n is an open-source workflow automation platform — visually composed workflows of 1000+ nodes including AI/LangChain nodes (AI Agent, vector stores, memory, tools), with triggers (webhook/schedule/poll/form/chat), credentials with encryption at rest, queue-mode execution (Redis-backed workers), self-host (Docker/Kubernetes) and n8n Cloud options, and source-control/embed for teams.
Sample tests· showing 3 of 9
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | Operator registers https://acme.example.com/webhook-test/abc-123 as the callback for a partner API. Partner POSTs after the workflow tab is closed. | /webhook-test/{path} is active only while the workflow is open in the editor with 'Listen for test event' on. Production callbacks must use /webhook/{path} on an ACTIVATED workflow. Update the partner's registered URL to the production path before going live. | Pass / FailAi Platformcritical |
| 02 | A public-internet webhook URL with `Authentication: None` is registered. The endpoint receives anonymous POSTs from scrapers and a prompt-injection payload lands in a downstream AI Agent node. | Always enable webhook authentication: Header Auth with a long shared secret, Basic Auth, or JWT validation. Even with auth, treat webhook body as untrusted input — sanitise before feeding into downstream LLM / SQL / shell surfaces. | Pass / FailAi Platformcritical |
| 03 | A payment webhook expects a 200 within 3s. The workflow does a 30s downstream data lookup. The provider keeps retrying because of timeouts. | Set webhook node `responseMode: 'onReceived'` (or 'responseNode' with a Respond to Webhook node early in the flow) to ack < 3s. Continue heavy processing downstream asynchronously. Use idempotency keys to deduplicate provider retries. | Pass / FailAi Platformcritical |
How this eval is graded
Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.
Rubric criteria
- N8n
- Ai Platform
- Triggers
Recommended for
Works with
Related evals
Claude API
Evaluates Anthropic's Batch API across 9 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Foundation Model & API eval coverage.
View AI PlatformClaude API
Evaluates Anthropic's Extended Thinking across 9 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Foundation Model & API eval coverage.
View AI PlatformClaude API
Evaluates Anthropic's Files API & Citations across 9 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Foundation Model & API eval coverage.
ViewFrequently asked questions
What does the Triggers eval for n8n n8n (self-host + Cloud) test?+
Evaluates n8n's Triggers across 9 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Workflow Automation eval coverage.
How is the Triggers eval scored?+
The judge rubric: Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.
How many test cases does this eval pack include?+
The Triggers pack for n8n n8n (self-host + Cloud) contains 9 test cases. 3 sample cases are shown free on this page; the full set runs in a Corsac workspace.
How do I run this eval?+
Sign up for Corsac, connect your model or agent endpoint, and run the Triggers pack as-is or after customizing thresholds. Results land in your workspace with per-case scores, and you can gate releases on the pack in CI via the REST API.
Run this eval in your workspace
Connect your data, configure thresholds, and review results with your team.