Webhooks Integrations
Linear · Linear
Linear evals — Webhooks & Integrations (relift v3)
About Linear
Linear is an AI-powered platform helping teams automate complex workflows, surface insights, and deliver better outcomes through intelligent automation.
Sample tests· showing 3 of 10
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | Webhook Issue update includes data.previousValues.priority and new priority. Customer endpoint must diff and alert only on escalation. | Compare previousValues.priority to new priority; trigger alert on increase; idempotent handler keyed by issue id + updatedAt. | Pass / FailWebhookhigh |
| 02 | GitHub integration expects branch or PR magic word linking. Operator pastes PR URL; agent should use documented GitHub integration flow, not raw issueUpdate alone. | Guide operator to include 'Fixes ENG-120' in PR or use GitHub integration linking UI; verify link appears on issue activity. | Pass / FailWorkflowmedium |
| 03 | Same issue id and updatedAt delivered twice. Handler writes to warehouse. Must use idempotency key from webhook delivery or payload hash. | Dedupe on issue id + updatedAt or webhook delivery id; second delivery is no-op success 200. | Pass / FailWebhookcritical |
Rubric criteria
- Linear
- Code Assistant
- Webhooks Integrations
Recommended for
Works with
Related evals
Run this eval in your workspace
Connect your data, configure thresholds, and review results with your team.