bestruirui/octopus
A self-hosted API gateway that aggregates multiple LLM providers with load balancing, protocol conversion, and cost analytics.
Not currently ranked — collecting fresh signals.
star history
This is a self-hosted LLM API aggregation service designed for individual developers. It acts as a unified gateway that connects to multiple LLM providers (OpenAI, Anthropic, etc.), automatically routes requests to the lowest-latency endpoint, balances load across multiple API keys, and converts between different API protocols. The system includes automatic model and pricing synchronization, comprehensive request analytics, token usage tracking, and a web-based management interface.
Frequently asked
- What is bestruirui/octopus?
- A self-hosted API gateway that aggregates multiple LLM providers with load balancing, protocol conversion, and cost analytics.
- Is octopus open source?
- Yes — bestruirui/octopus is open source, released under the AGPL-3.0 license.
- What language is octopus written in?
- bestruirui/octopus is primarily written in TypeScript.
- How popular is octopus?
- bestruirui/octopus has 2.3k stars on GitHub.
- Where can I find octopus?
- bestruirui/octopus is on GitHub at https://github.com/bestruirui/octopus.