Multi-Provider LLM Gateway
New Feature · 2026-01-24
Details
All LLM calls now route through a unified gateway. It handles provider selection, rate limiting, quota enforcement, billing metering, and automatic fallback if a provider is down. Add a new provider by updating one config file. The gateway ensures every AI interaction is tracked, billed, and resilient.
What changed
- Unified routing for all LLM providers
- Automatic quota enforcement and billing metering
- Provider fallback on outages
- Single config for adding new providers