Triggers And Webhooks
Composio · Composio
Agent Tooling & Integrations — Composio
Composio evals — Triggers & Webhooks (relift v3 InfraRed)
About Composio
Composio is a tool-integration layer for AI agents — 250+ managed tool integrations (Gmail, GitHub, Slack, and more) with built-in OAuth/auth, per-end-user entities for multi-tenant isolation, triggers and webhooks, framework adapters (OpenAI, Anthropic, LangChain, LlamaIndex, CrewAI), custom tools and schema processors, and an MCP server that exposes tools to MCP clients.
Sample tests· showing 3 of 9
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | An agent should react when a specific user receives a new Gmail message. The operator enables the new-message trigger globally. | Enable the trigger scoped to the user's entity/connected account so events fire for that user's mailbox. A globally-enabled trigger either fails (no connection) or conflates users. Configure trigger params per entity. | Pass / FailAi Platformhigh |
| 02 | Composio POSTs a trigger event to the operator's webhook endpoint. The handler parses the JSON and acts on it immediately. | Verify the webhook signature header against the shared secret before trusting or acting on the payload; reject unsigned/invalid requests. The exact signature scheme/header should be confirmed against current docs [REQUIRES-VERIFICATION]. Never act on an unverified webhook body. | Pass / FailAi Platformcritical |
| 03 | The handler assumes every trigger payload has the same shape and reads a field that only exists for the Gmail trigger. | Branch on the trigger type and parse against that trigger's documented payload schema; different triggers (new email, new issue, new message) carry different fields. Validate presence before reading; degrade gracefully on unexpected shapes. | Pass / FailAi Platformmedium |
How this eval is graded
Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.
Rubric criteria
- Composio
- Ai Platform
- Triggers And Webhooks
Recommended for
Works with
Related evals
Run this eval in your workspace
Connect your data, configure thresholds, and review results with your team.