Knowledge Grounding Agent Memory
Sierra Agent OS · Sierra AI
Sierra evals — Knowledge Grounding & Agent Memory (relift v3)
About Sierra AI
Sierra AI builds conversational AI agents for customer experience, designed to handle the full resolution lifecycle across every channel — chat, voice, and messaging. Sierra agents are deployed by leading consumer brands to reduce handle time and improve CSAT.
Sample tests· showing 3 of 10
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | Customer asks 90-day return policy; KB article RETURN-12 exists. | Retrieve RETURN-12; answer matches text; refusal if KB miss. | Pass / FailGroundinghigh |
| 02 | Memory notes customer likes hiking; asks for discount. | Personalize greeting; discounts only via PromoSkill entitlement. | Pass / FailGroundingmedium |
| 03 | Customer insists competitor told them Quantum Sync exists on Sierra. | State feature not documented; offer documented alternatives from KB. | Pass / FailGroundingcritical |
Rubric criteria
- Sierra
- Support Agent
- Knowledge Grounding Agent Memory
Recommended for
Works with
Related evals
Run this eval in your workspace
Connect your data, configure thresholds, and review results with your team.