Eval directory
Evals for Cogent Security
8 evaluation packs covering adversarial robustness, safety gates, workflow quality, and operator-level checks for Cogent Security AI products.
About Cogent Security
Cogent Security builds agentic AI for vulnerability management. The Cogent Platform runs Triage, Risk Assessment, Remediation, and Verification agents on a real-time data foundation — investigating findings, correlating assets to owning teams, prioritizing by real exploitability over raw CVSS, driving remediation through engineering workflows, and validating that fixes actually happened. The free Cogent Community surface pairs VulnCheck-powered CVE intelligence with a customizable Discover Feed and an AI Research Assistant that produces cited, plain-language deep-dives.
Employees
~30
Industry
AI Security / Vulnerability Management
Headquarters
San Francisco, CA
Website
www.cogent.comHow complete this published benchmark library is across datasets, metrics, rubrics, use-case maps, and pack context. This is library coverage, not an agent performance score.
Test datasets
8/8 packs
Scoring metrics
0/8 packs
Judge rubrics
8/8 packs
Use-case maps
0/8 packs
Pack context
8/8 packs
Available eval packs for Cogent Security
8 packs ready to run.
Cogent Cogent Community Discover Feed And Research Assistant
Evaluates Cogent Security's Cogent Community: Discover Feed & Research Assistant across 9 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Agentic AI Vulnerability Management eval coverage.
Cogent Remediation Orchestration And Ticketing
Evaluates Cogent Security's Remediation Orchestration & Ticketing across 9 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Agentic AI Vulnerability Management eval coverage.
Cogent Risk Assessment And Contextual Prioritization
Evaluates Cogent Security's Risk Assessment & Contextual Prioritization across 9 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Agentic AI Vulnerability Management eval coverage.
Cogent Safety Governance And Human In The Loop
Evaluates Cogent Security's Safety, Governance & Human-in-the-Loop across 10 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Agentic AI Vulnerability Management eval coverage.
Cogent Scanner Ingestion Asset Graph And Normalization
Evaluates Cogent Security's Scanner Ingestion, Asset Graph & Normalization across 9 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Agentic AI Vulnerability Management eval coverage.
Cogent Triage And Investigation Agent
Evaluates Cogent Security's Triage & Investigation Agent across 9 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Agentic AI Vulnerability Management eval coverage.
Cogent Verification And Closure Validation
Evaluates Cogent Security's Verification & Closure Validation across 9 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Agentic AI Vulnerability Management eval coverage.
Cogent Vulncheck Powered Cve Knowledge Base
Evaluates Cogent Security's VulnCheck-Powered CVE Knowledge Base across 9 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Agentic AI Vulnerability Management eval coverage.
Why eval Cogent Security AI
Cogent Security's AI features ship behind brand promises about accuracy, safety, and reliability. Buyers and integrators need to know those promises hold up under adversarial prompts, edge-case workflows, and the long tail of real customer inputs — not just the demo path.
The Corsac eval library for Cogent Security measures four dimensions teams care about most when deploying ai platform agents:
- Adversarial robustness — does the agent resist prompt injection, jailbreaks, and social-engineering attempts?
- Workflow quality— does it complete the task buyers were shown in the demo, on inputs that don't look like the demo?
- Safety gates — does it escalate or refuse when it should, and only then?
- Operator quality — does it preserve analyst trust by surfacing the right context at the right time?
Every eval pack above is hand-authored against Cogent Security's public product surface and runnable in Corsac with your own data.