Pyyan / Routers & Gateways
Routers & Gateways
18 entriesOne API across many models. · ranked by adoption and measured overhead · verified 13 Aug 2026
| # | Name | Added latency | Hosting | Caching | Status |
|---|---|---|---|---|---|
| 1 | OpenRouter | 40–55ms | Managed | — | current |
| 2 | BLiteLLM BerriAI | Self-hosted | Self | Redis | current |
| 3 |  Requesty | 8ms P50 | Managed | — | current |
| 4 |  Portkey | 8–20ms | Both | Semantic | current |
| 5 | Cloudflare AI Gateway Cloudflare | Edge | Managed | — | current |
| 6 | HHelicone | Low | Both | — | current |
| 7 | VVercel AI Gateway Vercel | Low | Managed | — | current |
| 8 |  TrueFoundry | Low | Both | — | current |
| 9 |  Kong AI GatewayKong | Varies | Self | — | current |
| 10 |  Not Diamond | Low | Managed | — | current |
| 11 |  Martian | Low | Managed | — | current |
| 12 |  BifrostMaxim | Self-hosted | Self | — | current |
| 13 |  FloTorch GatewayFloTorch | Low | Both | — | current |
| 14 | AArize AI Arize | Low | Managed | — | current |
| 15 | Aaisuite Andrew Ng | None | Library | — | current |
| 16 | VVercel AI SDK Vercel | None | Library | — | current |
| 17 |  Ollama | Local | Self | — | current |
| 18 | VvLLM | Local | Self | — | current |