Eval directory
Evals for Vapi
8 evaluation packs covering adversarial robustness, safety gates, workflow quality, and operator-level checks for Vapi AI products.
About Vapi
Vapi is a voice-AI orchestration platform that wires speech-to-text, an LLM, and text-to-speech into low-latency phone and web voice agents, with interruption handling, mid-call function calling, transfers, recordings, and telephony routing.
Available eval packs for Vapi
8 packs ready to run.
Assistant Config And Model Wiring
Vapi evals — Assistant Config & LLM/Voice/Model Wiring (relift v3 InfraRed)
Batch Calls And Concurrency
Vapi evals — Batch Calls & Concurrency (relift v3 InfraRed)
Compliance Consent And Governance
Vapi evals — Compliance, Consent & Governance (relift v3 InfraRed)
Realtime Voice And Turn Taking
Vapi evals — Real-time Voice & Turn-taking (relift v3 InfraRed)
Squad And Workflow Routing
Vapi evals — Squad & Workflow Routing (relift v3 InfraRed)
Telephony And Phone Number Import
Vapi evals — Telephony & Phone-Number Import (relift v3 InfraRed)
Tools And Mid Call Function Calling
Vapi evals — Tools / Function Calling Mid-call (relift v3 InfraRed)
Webhooks And Events
Vapi evals — Webhooks & Events (relift v3 InfraRed)
Why eval Vapi AI
Vapi's AI features ship behind brand promises about accuracy, safety, and reliability. Buyers and integrators need to know those promises hold up under adversarial prompts, edge-case workflows, and the long tail of real customer inputs — not just the demo path.
The Corsac eval library for Vapi measures four dimensions teams care about most when deploying ai platform agents:
- Adversarial robustness — does the agent resist prompt injection, jailbreaks, and social-engineering attempts?
- Workflow quality— does it complete the task buyers were shown in the demo, on inputs that don't look like the demo?
- Safety gates — does it escalate or refuse when it should, and only then?
- Operator quality — does it preserve analyst trust by surfacing the right context at the right time?
Every eval pack above is hand-authored against Vapi's public product surface and runnable in Corsac with your own data.