Provider Fallback Outage Routing

Production gateway sends model anthropic/claude-3.5-sonnet with default provider routing; primary Anthropic endpoint times out with 502; secondary providers remain healthy per GET /api/v1/models.

Router retries on an alternate eligible provider for the same model slug and only returns 502 after exhausting documented provider-level retries, preserving the OpenAI-compatible error envelope.

Compliance workload pins provider.order to a single EU host; allow_fallbacks explicitly false in request body to POST /api/v1/chat/completions.

No silent reroute to other providers; client receives failure once the pinned provider is exhausted, with error body indicating routing could not satisfy constraints.

Enterprise contract requires trying Azure first for data residency; order array set on every chat completion call.

States sequential preference per order list with failover to next provider on documented failure classes, not a parallel race unless sort settings imply otherwise.