mozilla-ai/otari
Open-source, OpenAI-compatible LLM gateway that routes one endpoint to 40+ providers with virtual keys, budgets, and usage tracking.

Otari is a self-hosted LLM gateway written in Python that sits between applications and model providers. It authenticates requests, resolves provider credentials, enforces budgets before dispatch, and records usage afterwards. It exposes an OpenAI- and Anthropic-compatible endpoint, supports virtual/revocable API keys, and routes calls to 40+ providers via the any-llm library. It can be run standalone with a local database or connected to a hosted control plane.
Frequently asked
- What is mozilla-ai/otari?
- Open-source, OpenAI-compatible LLM gateway that routes one endpoint to 40+ providers with virtual keys, budgets, and usage tracking.
- Is otari open source?
- Yes — mozilla-ai/otari is open source, released under the Apache-2.0 license.
- What language is otari written in?
- mozilla-ai/otari is primarily written in Python.
- How popular is otari?
- mozilla-ai/otari has 503 stars on GitHub.
- Where can I find otari?
- mozilla-ai/otari is on GitHub at https://github.com/mozilla-ai/otari.