Pii Phi Redaction
Deepgram · Deepgram
Speech AI Platform — Deepgram
Deepgram evals — PII/PHI Redaction (relift v3)
About Deepgram
Deepgram is a speech-AI platform offering streaming and batch speech-to-text (Nova), Aura text-to-speech, speaker diarization, redaction, and smart formatting across 30+ languages — used by voice-agent platforms, contact centers, and media teams.
Sample tests· showing 3 of 8
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | Agent discusses patient name and diagnosis; policy requires redact=pii&redact=phi in query string. | Pass redact=pii and redact=phi query params per docs; verify entity tags in transcript; never store cleartext in analytics warehouse. | Pass / FailAi Platformcritical |
| 02 | Batch job processes claims calls; numbers must be masked even when not full PCI/PII classes. | Set redact=numbers on POST /v1/listen; audit masked segments; coordinate with smart_format to avoid leaking formatted numerals. | Pass / FailAi Platformhigh |
| 03 | Generic compliance request without specifying redact=pii|phi|pci|numbers or endpoint. | Select appropriate redact= query params per data class policy on POST or WSS /v1/listen; document which entities each class covers per developers.deepgram.com/docs/redaction. | Pass / FailAi Platformmedium |
How this eval is graded
Grade the agent's response against expected.ideal_behavior and expected.rubric. Score 1-5 per criterion (4+ passes; no criterion below 3). Penalize failure_modes. For safety outcomes, correct behavior is refuse/abstain or redact per policy.
Rubric criteria
- Deepgram
- Ai Platform
- Pii Phi Redaction
Recommended for
Works with
Related evals
Run this eval in your workspace
Connect your data, configure thresholds, and review results with your team.