← all repositories

aurelio-labs/semantic-router

A Python library providing a fast semantic routing layer for LLMs and agents to make tool-use decisions without waiting for slow LLM generations.

3.6k stars Python AgentsLLMOps · Eval
semantic-router
Velocity · 7d
+3.8
★ / day
Trend
steady
star history

Semantic Router is a decision-making layer for LLMs and agents that uses semantic vector embeddings to route requests instead of waiting for slow LLM generations. It enables fast, intelligent routing based on the semantic meaning of user queries. The library supports multi-modal data processing and integrates with HuggingFace encoders for local deployment as well as cloud-based LLM options. It is designed to accelerate agent workflows by offloading routing decisions from the LLM to a vector-based routing system.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.