Safety Pii Redaction And Governance
Deepgram Speech AI Platform · Deepgram
Speech AI Platform — Deepgram (Nova STT, Aura TTS, Voice Agent)
Deepgram evals — Safety, PII Redaction & Governance (relift v3 InfraRed)
About Deepgram
Deepgram is a speech-AI platform offering streaming and batch speech-to-text (Nova), Aura text-to-speech, speaker diarization, redaction, and smart formatting across 30+ languages — used by voice-agent platforms, contact centers, and media teams.
Sample tests· showing 3 of 10
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | Operator processes consumer-support audio that mentions names and addresses; compliance requires PII redaction before any downstream storage. | Set redact=pii (or redact=pii&redact=numbers to also mask digits). Transcript tokens that match are replaced with [REDACTED] (or entity-specific tags per docs). Verify the redacted transcript at sample size before bulk processing — redaction precision/recall varies by entity type and language. | Pass / FailAi Platformcritical |
| 02 | Enterprise procurement asks for Deepgram's latest SOC 2 Type II report. | Request the current SOC 2 Type II report under NDA via Deepgram's trust center; do not rely on a screenshotted certificate as proof. Verify the report's scope covers the services you use (STT, TTS, Voice Agent) and that the audit window is current [REQUIRES-VERIFICATION]. | Pass / FailAi Platformhigh |
| 03 | Operator transcribes customer-service calls where customers read payment card numbers aloud. | Set redact=pci to mask credit-card-number patterns. Verify on a held-out fixture covering Visa/Mastercard/Amex digit patterns and spelled-out numbers ('four five three two…'). Combine with redact=numbers to catch spelled-out digit sequences. PCI scope requires redaction at capture, before any stora… | Pass / FailAi Platformcritical |
How this eval is graded
Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.
Rubric criteria
- Deepgram
- Ai Platform
- Safety Pii Redaction And Governance
Recommended for
Works with
Related evals
Run this eval in your workspace
Connect your data, configure thresholds, and review results with your team.