ElevenLabs
For ElevenLabsVoice AIAi Platform

Dubbing Multilingual Localization

ElevenLabs · ElevenLabs

Voice AI platform — ElevenLabs

Evaluates ElevenLabs' Dubbing & Multilingual Localization across 9 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Voice AI platform eval coverage.

About ElevenLabs

ElevenLabs is a voice AI platform that generates natural, expressive speech for any use case — from conversational agents and audiobooks to real-time dubbing and voice cloning. Its API powers production voice experiences across more than 30 languages.

Employees

~200

Industry

Voice AI

Headquarters

New York, NY

Sample tests· showing 3 of 9

#InputExpected behaviorCheck
01

Source English video 12 min; target ar; subtitles must render RTL in player bundle.

Create dubbing project with target ar; verify RTL metadata in subtitle export; adjust TTS pace for MSA clarity.

Pass / FailWorkflowhigh
02

Dubbing render pass 2; automatic offset detector fired; integrator asked for MOS grading.

Trigger lip-sync retry job with offset parameter; report offset ms before/after; explicitly decline MOS subjective scoring.

Pass / FailWorkflowmedium
03

Source JA; target zh-CN; on-screen text boxes fixed width; agent must shorten lines not just translate.

Run dubbing pipeline with segment timing agent that shrinks zh line length to fit boxes; log per-segment timing deltas.

Pass / FailWorkflowhigh

Unlock full benchmark

6 more test cases

Use this benchmark

How this eval is graded

Grade against expected.ideal_behavior and expected.rubric.

Rubric criteria

  • Elevenlabs
  • Ai Platform
  • Dubbing Multilingual Localization

Recommended for

ElevenLabsElevenLabs customers

Works with

Related evals

Frequently asked questions

What does the Dubbing Multilingual Localization eval for ElevenLabs ElevenLabs test?+

Evaluates ElevenLabs' Dubbing & Multilingual Localization across 9 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Voice AI platform eval coverage.

How is the Dubbing Multilingual Localization eval scored?+

The judge rubric: Grade against expected.ideal_behavior and expected.rubric.

How many test cases does this eval pack include?+

The Dubbing Multilingual Localization pack for ElevenLabs ElevenLabs contains 9 test cases. 3 sample cases are shown free on this page; the full set runs in a Corsac workspace.

How do I run this eval?+

Sign up for Corsac, connect your model or agent endpoint, and run the Dubbing Multilingual Localization pack as-is or after customizing thresholds. Results land in your workspace with per-case scores, and you can gate releases on the pack in CI via the REST API.

Run this eval in your workspace

Connect your data, configure thresholds, and review results with your team.