← all repositories

bestruirui/octopus

A self-hosted API gateway that aggregates multiple LLM providers with load balancing, protocol conversion, and cost analytics.

2.2k stars TypeScript LLMOps · EvalInference · Serving
octopus
Velocity · 7d
+11
★ / day
Trend
steady
star history

This is a self-hosted LLM API aggregation service designed for individual developers. It acts as a unified gateway that connects to multiple LLM providers (OpenAI, Anthropic, etc.), automatically routes requests to the lowest-latency endpoint, balances load across multiple API keys, and converts between different API protocols. The system includes automatic model and pricing synchronization, comprehensive request analytics, token usage tracking, and a web-based management interface.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.