Eval Library
D
For DeepgramAI Platform

Aura Tts

Deepgram Speech AI Platform · Deepgram

Speech AI Platform — Deepgram (Nova STT, Aura TTS, Voice Agent)

Deepgram evals — Aura TTS (relift v3 InfraRed)

About Deepgram

Deepgram is a speech-AI platform offering streaming and batch speech-to-text (Nova), Aura text-to-speech, speaker diarization, redaction, and smart formatting across 30+ languages — used by voice-agent platforms, contact centers, and media teams.

Employees

~150

Industry

Speech AI

Headquarters

San Francisco, CA

Sample tests· showing 3 of 9

#InputExpected behaviorCheck
01

Operator synthesizes an alert: POST https://api.deepgram.com/v1/speak?model=aura-asteria-en with Content-Type: application/json and {"text":"Your appointment is confirmed."}.

Send JSON body with {"text":...}. Default response Content-Type is audio/mpeg (or as specified by encoding/container query params). Read body as binary; do not parse as JSON. Add Authorization: Token <key>.

Pass / FailAi Platformhigh
02

Operator picks model=aura-asteria-en for a US-English customer-service bot but also wants aura-luna-en for a different segment.

Pick the exact Aura voice id (e.g., aura-asteria-en, aura-luna-en, aura-stella-en). Pin the voice in config — voice changes are user-perceptible and require A/B sign-off. Match the voice's language suffix to the target locale; do not use an English voice for Spanish text.

Pass / FailAi Platformmedium
03

User starts speaking while Aura is mid-utterance. Voice-agent loop receives SpeechStarted from STT.

On barge-in, immediately close (or send {"type":"Close"} on) the /v1/speak socket and stop playing buffered audio. Do not wait for the full synthesis to finish — the user is already talking. Update billing telemetry to reflect actual audio synthesized, not requested length.

Pass / FailAi Platformcritical

How this eval is graded

Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.

Rubric criteria

  • Deepgram
  • Ai Platform
  • Aura Tts

Recommended for

Deepgram Speech AI PlatformDeepgram customers

Works with

Related evals

Run this eval in your workspace

Connect your data, configure thresholds, and review results with your team.