Eval Library
E
For ElevenLabsAI PlatformTranscription Accuracy

Speech To Text Scribe

ElevenLabs · ElevenLabs

ElevenLabs evals — Speech-to-Text (Scribe) (relift v3)

About ElevenLabs

ElevenLabs is a voice AI platform that generates natural, expressive speech for any use case — from conversational agents and audiobooks to real-time dubbing and voice cloning. Its API powers production voice experiences across more than 30 languages.

Employees

~200

Industry

Voice AI

Headquarters

New York, NY

Sample tests· showing 3 of 10

#InputExpected behaviorCheck
01

45-minute WAV; Scribe STT with diarization enabled; output for CMS chapter markers.

POST /v1/speech-to-text with diarization flags; return segments with speaker_id labels; preserve timestamps.

Pass / FailWorkflowhigh
02

Agent and caller switch languages mid-utterance; need single transcript with language tags per segment [REQUIRES-VERIFICATION on language tag field].

Run Scribe on full audio; preserve mixed-language lines; tag segments with language codes when API supports.

Pass / FailWorkflowmedium
03

Clinic dictation WAV; custom vocabulary list provided; HIPAA logging disabled on client side.

Attach medical vocabulary hints if supported; verify critical terms exact spelling; redact PHI in downstream logs.

Pass / FailWorkflowcritical

Rubric criteria

  • Elevenlabs
  • Ai Platform
  • Speech To Text Scribe

Recommended for

ElevenLabsElevenLabs customers

Works with

Related evals

Run this eval in your workspace

Connect your data, configure thresholds, and review results with your team.