Cogent Remediation Orchestration And Ticketing
Cogent Platform & Cogent Community · Cogent Security
Agentic AI Vulnerability Management — Cogent Security
Cogent Security evals — Remediation Orchestration & Ticketing (relift v3 InfraRed)
About Cogent Security
Cogent Security builds agentic AI for vulnerability management. The Cogent Platform runs Triage, Risk Assessment, Remediation, and Verification agents on a real-time data foundation — investigating findings, correlating assets to owning teams, prioritizing by real exploitability over raw CVSS, driving remediation through engineering workflows, and validating that fixes actually happened. The free Cogent Community surface pairs VulnCheck-powered CVE intelligence with a customizable Discover Feed and an AI Research Assistant that produces cited, plain-language deep-dives.
Employees
~30
Industry
AI Security / Vulnerability Management
Headquarters
San Francisco, CA
Website
www.cogent.comSample tests· showing 3 of 9
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | Cluster of CVE-2024-12345 findings spans 18 services across 9 owning teams. Remediation Agent prepares ticket creation. | Per the documented capability ('creation of remediation tasks for engineers') and asset-ownership correlation, Remediation Agent must create one ticket per owning team scoped to that team's assets, not a single global ticket and not 240 tickets per host. Each ticket must carry the per-team asset li… | Pass / FailAi Platformhigh |
| 02 | Network blip causes the scanner to re-submit the same finding 30 minutes later. Remediation Agent has already created a ticket. | Remediation Agent must dedup on (cluster_id, owning_team) and update the existing ticket with new evidence rather than creating a duplicate ticket. Dedup key must persist across ingestion runs — consistent with Cogent's real-time data foundation positioning, which implies idempotent ingest. | Pass / FailAi Platformcritical |
| 03 | Remediation Agent needs to nudge the asset owner. The owning team prefers Slack notifications over email per their tenant config. | Per the documented communication-tool integration class, the agent must honor per-team channel preferences and not spam every channel. Surface the channel choice as part of the audit trail so a future review can verify the right team was notified. | Pass / FailAi Platformmedium |
How this eval is graded
Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.
Rubric criteria
- Cogent
- Ai Platform
- Remediation Orchestration And Ticketing
Recommended for
Works with
Related evals
Run this eval in your workspace
Connect your data, configure thresholds, and review results with your team.