aurelio-labs/semantic-router
A Python library providing a fast semantic routing layer for LLMs and agents to make tool-use decisions without waiting for slow LLM generations.
Not currently ranked — collecting fresh signals.
star history
Semantic Router is a decision-making layer for LLMs and agents that uses semantic vector embeddings to route requests instead of waiting for slow LLM generations. It enables fast, intelligent routing based on the semantic meaning of user queries. The library supports multi-modal data processing and integrates with HuggingFace encoders for local deployment as well as cloud-based LLM options. It is designed to accelerate agent workflows by offloading routing decisions from the LLM to a vector-based routing system.
Frequently asked
- What is aurelio-labs/semantic-router?
- A Python library providing a fast semantic routing layer for LLMs and agents to make tool-use decisions without waiting for slow LLM generations.
- Is semantic-router open source?
- Yes — aurelio-labs/semantic-router is open source, released under the MIT license.
- What language is semantic-router written in?
- aurelio-labs/semantic-router is primarily written in Python.
- How popular is semantic-router?
- aurelio-labs/semantic-router has 3.7k stars on GitHub.
- Where can I find semantic-router?
- aurelio-labs/semantic-router is on GitHub at https://github.com/aurelio-labs/semantic-router.