bestruirui/octopus
A self-hosted API gateway that aggregates multiple LLM providers with load balancing, protocol conversion, and cost analytics.

This is a self-hosted LLM API aggregation service designed for individual developers. It acts as a unified gateway that connects to multiple LLM providers (OpenAI, Anthropic, etc.), automatically routes requests to the lowest-latency endpoint, balances load across multiple API keys, and converts between different API protocols. The system includes automatic model and pricing synchronization, comprehensive request analytics, token usage tracking, and a web-based management interface.