Sample data. Not a customer bill.
Provider health
PlannedUptime, errors, latency, fallbacks and gateway overhead.
View
Gateway overhead p50
20 ms
Sample gateway overhead. The gateway is not deployed.
Gateway overhead p95
24 ms
Fallback events
10
Recovered requests, HTTP 200
| Provider | Requests | Error rate | Success without fallback | p50 | p95 | Overhead p50 |
|---|---|---|---|---|---|---|
| OpenAI | 12 | 16.7% | 83.33% | 675 ms | 765 ms | 20 ms |
| Anthropic | 36 | 16.7% | 83.33% | 675 ms | 765 ms | 20 ms |
| Google Gemini | 12 | 16.7% | 83.33% | 675 ms | 765 ms | 20 ms |
| Mistral | 0 | 0.0% | No samples | — | — | — |
| DeepSeek | 0 | 0.0% | No samples | — | — | — |
| Qwen | 0 | 0.0% | No samples | — | — | — |
| Cohere | 0 | 0.0% | No samples | — | — | — |
| Meta hosts | 0 | 0.0% | No samples | — | — | — |
| Self-hosted | 0 | 0.0% | No samples | — | — | — |
Fallback timeline
Open in logs- req_northwind_0049support-replyanthropic600 ms
- req_northwind_0037eval-backfillgoogle600 ms
- req_northwind_0025doc-extractanthropic600 ms
- req_northwind_0013ticket-triageopenai600 ms
- req_northwind_0001support-replyanthropic600 ms
- req_northwind_0060support-replyanthropic765 ms
- req_northwind_0048eval-backfillgoogle765 ms
- req_northwind_0036doc-extractanthropic765 ms