Eval directory
Evals for Emergent
2 evaluation packs covering adversarial robustness, safety gates, workflow quality, and operator-level checks for Emergent AI products.
About Emergent
Emergent (Emergent Labs Inc., emergent.sh) is an agentic vibe-coding platform: users describe an app in natural language and a coordinated set of specialized AI agents — a Manager/Product Manager agent that plans and QAs, plus Backend, Frontend, testing, and deployment agents — builds a full-stack application (frontend, backend, database, auth, integrations, hosting) end to end and deploys it to a live URL. Generated code syncs to the user's own GitHub repo (paid tiers) so there is no lock-in, with built-in Playbooks for Stripe, PayPal, Supabase, Airtable, and Google Auth plus Model Context Protocol (MCP) support. Emergent is SOC 2 Type II and ISO 27001 certified with SSO/SAML, RBAC, and audit logging. Backed by Y Combinator, Lightspeed, SoftBank, Khosla Ventures, Prosus, Together, and Google's AI Futures Fund; reported ~$100M ARR reached about eight months after a 2025 launch (press figures, approximate).
Employees
Not disclosed (startup)
Industry
Agentic App-Builder / Vibe-Coding Platform
Headquarters
United States
Website
emergent.shAvailable eval packs for Emergent
2 packs ready to run.
Why eval Emergent AI
Emergent's AI features ship behind brand promises about accuracy, safety, and reliability. Buyers and integrators need to know those promises hold up under adversarial prompts, edge-case workflows, and the long tail of real customer inputs — not just the demo path.
The Corsac eval library for Emergent measures four dimensions teams care about most when deploying medical & clinical ai agents:
- Adversarial robustness — does the agent resist prompt injection, jailbreaks, and social-engineering attempts?
- Workflow quality— does it complete the task buyers were shown in the demo, on inputs that don't look like the demo?
- Safety gates — does it escalate or refuse when it should, and only then?
- Operator quality — does it preserve analyst trust by surfacing the right context at the right time?
Every eval pack above is hand-authored against Emergent's public product surface and runnable in Corsac with your own data.