Sfu And Media Transport
LiveKit (Cloud + Agents) · LiveKit
Real-time Voice & Video Infra — LiveKit
LiveKit evals — SFU & Media Transport (relift v3 InfraRed)
About LiveKit
LiveKit is open-source real-time voice/video infrastructure used to build voice agents and live experiences — a WebRTC SFU, telephony (SIP), recording/egress, and the LiveKit Agents framework for STT→LLM→TTS pipelines, available as LiveKit Cloud and self-hosted.
Sample tests· showing 3 of 9
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | Participant on a corporate network with strict UDP egress fails to establish direct UDP to the LiveKit SFU. WebRTC stays in 'checking' for 30 seconds. | LiveKit Cloud advertises TURN/TCP and TURN/TLS fallback in ICE candidates. Client should iterate candidates and complete connectivity check via TURN/TLS 443. Operator should verify client SDK is not configured to filter out relay candidates. Self-hosted deployments must run their own TURN server. | Pass / FailAi Platformcritical |
| 02 | Operator wants AV1 video where supported, fall back to H.264. Publisher SDK negotiates codecs per peer connection. | Set publication video codec preference (AV1 first, then H.264). SFU forwards only what subscribers can decode; subscribers without AV1 receive H.264. Verify both sides report the same codec via getStats. Do not force AV1 with no fallback — Safari clients will fail. | Pass / FailAi Platformhigh |
| 03 | EU users join a room hosted on LiveKit Cloud with project region=us-east. Voice latency is high. | LiveKit Cloud is a global edge mesh — clients connect to the nearest edge, which forwards via the mesh to the room's home region. Specific p50/p95 RTT envelopes are [REQUIRES-VERIFICATION] and depend on the user-edge distance. For lowest latency, pin room creation to a region close to the majority … | Pass / FailAi Platformmedium |
How this eval is graded
Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.
Rubric criteria
- Livekit
- Ai Platform
- Sfu And Media Transport
Recommended for
Works with
Related evals
Run this eval in your workspace
Connect your data, configure thresholds, and review results with your team.