Your LLM gateway, chat app, and billing department in one box

What it does

CoAI.Dev acts as a unified proxy for dozens of LLM providers—OpenAI, Anthropic, Gemini, Midjourney, and others—exposing them through an OpenAI-compatible API. It includes a responsive web interface built around Shadcn UI, with file parsing, web search, and conversation sync, alongside an admin dashboard for user management, channel routing, and both subscription and usage-based billing.

The interesting bit

Rather than stitching together a gateway, a frontend, and a billing system, CoAI.Dev tries to be all three in one deployable unit. Its channel management supports priority-based routing, weighted load balancing, and automatic retry between upstreams, while built-in model caching hashes request parameters to skip redundant API calls and their associated costs.

Key highlights

• Supports 200+ models across 35+ providers via a standard OpenAI-compatible proxy, including vision, function calling, and image generation endpoints.
• Enterprise-style channel management with priority queues, weighted load balancing, model redirection, and upstream hiding.
• Built-in billing engine handling both subscriptions and elastic per-request or per-token pricing, plus gift codes and redemption codes.
• Out-of-the-box file parsing for PDFs, Office documents, and images with OCR, plus web search powered by SearXNG.
• Cross-device conversation sync and sharing without WebDAV or WebRTC dependencies; available as a PWA and Tauri desktop app.
• Apache 2.0 license, commercially friendly.

Caveats

• Several advanced features—TTS/STT, RAG knowledge base, plugin marketplace, and channel health alarms—are reserved for the commercial Pro version.
• A handful of side features like the AI Project Generator and AI Card function have been discontinued in the open-source branch.
• The default admin credentials documented are root / chatnio123456, so you will want to change them immediately.

Verdict

Ideal for developers or small teams who need to launch a multi-tenant AI service with billing and provider failover without maintaining a patchwork of separate tools. Skip it if you just want a lightweight API proxy or a personal chat client.