← all repositories

mnfst/manifest

Open-source LLM gateway that intelligently routes agent requests across multiple model providers to reduce costs by up to 70%.

6.8k stars TypeScript Inference · ServingLLMOps · Eval
manifest
Velocity · 7d
+5.1
★ / day
Trend
steady
star history

Manifest is a model routing gateway built for AI agents that automatically selects the optimal LLM provider (OpenAI, Anthropic, etc.) for each request based on cost and performance. It provides token tracking, cost observability, and request-level routing decisions to help teams build cheaper and more efficient AI applications. The project includes a gateway server, SDKs, and integrates with agent frameworks.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.