ai-gateway

ai-gateway - OpenAI-compatible LLM gateway that routes requests across 30 providers with fallback, rate limiting, budgets, guardrails, and observability.

View Repository
287 Stars
40 Forks
Apache-2.0 License
Go Language
2026-11-02 Last Update
65 Open Issues
ai-gateway ai-infrastructure guardrails litellm llm llm-cost llm-gateway llm-proxy llm-strategy llmops mcp openai-compatible pii-detection prompt-management semantic-cache token-saver
← All Artificial Intelligence