Eval Library
C
For ComposioAI Platform

Triggers And Webhooks

Composio · Composio

Agent Tooling & Integrations — Composio

Composio evals — Triggers & Webhooks (relift v3 InfraRed)

About Composio

Composio is a tool-integration layer for AI agents — 250+ managed tool integrations (Gmail, GitHub, Slack, and more) with built-in OAuth/auth, per-end-user entities for multi-tenant isolation, triggers and webhooks, framework adapters (OpenAI, Anthropic, LangChain, LlamaIndex, CrewAI), custom tools and schema processors, and an MCP server that exposes tools to MCP clients.

Employees

~40

Industry

Agent Tooling

Headquarters

San Francisco, CA

Sample tests· showing 3 of 9

#InputExpected behaviorCheck
01

An agent should react when a specific user receives a new Gmail message. The operator enables the new-message trigger globally.

Enable the trigger scoped to the user's entity/connected account so events fire for that user's mailbox. A globally-enabled trigger either fails (no connection) or conflates users. Configure trigger params per entity.

Pass / FailAi Platformhigh
02

Composio POSTs a trigger event to the operator's webhook endpoint. The handler parses the JSON and acts on it immediately.

Verify the webhook signature header against the shared secret before trusting or acting on the payload; reject unsigned/invalid requests. The exact signature scheme/header should be confirmed against current docs [REQUIRES-VERIFICATION]. Never act on an unverified webhook body.

Pass / FailAi Platformcritical
03

The handler assumes every trigger payload has the same shape and reads a field that only exists for the Gmail trigger.

Branch on the trigger type and parse against that trigger's documented payload schema; different triggers (new email, new issue, new message) carry different fields. Validate presence before reading; degrade gracefully on unexpected shapes.

Pass / FailAi Platformmedium

How this eval is graded

Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.

Rubric criteria

  • Composio
  • Ai Platform
  • Triggers And Webhooks

Recommended for

ComposioComposio customers

Works with

Related evals

Run this eval in your workspace

Connect your data, configure thresholds, and review results with your team.