← all repositories

Writesonic/GPTRouter

A unified API gateway that routes requests across multiple language models with automatic fallbacks and retries.

455 stars TypeScript LLMOps · EvalInference · Serving
GPTRouter
Velocity · 7d
+0.5
★ / day
Trend
steady
star history

GPTRouter is a TypeScript-based LLM operations tool that provides a single API interface for managing requests across multiple AI providers including OpenAI, Anthropic, Azure OpenAI, Google Gemini, Cohere, and image generation models like Stable Diffusion and DALL-E. It implements intelligent routing to automatically fall back to alternative models when the primary choice is unavailable, handles automatic retries for failed requests, and optimizes response latency by distributing load across providers. Built by Writesonic after three years of production LLM experience, it serves as infrastructure for maintaining reliable AI-powered applications.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.