hyperonym/basaran
OpenAI-compatible API server for running open-source text generation models from Hugging Face.
Not currently ranked — collecting fresh signals.
star history
Basaran provides an open-source alternative to the OpenAI text completion API, enabling applications to switch from OpenAI to self-hosted open-source models without code changes. It wraps Hugging Face Transformers-based text generation models with a streaming API supporting various decoding strategies, quantization, and multi-GPU setups, and includes a web-based playground interface.
Frequently asked
- What is hyperonym/basaran?
- OpenAI-compatible API server for running open-source text generation models from Hugging Face.
- Is basaran open source?
- Yes — hyperonym/basaran is open source, released under the MIT license.
- What language is basaran written in?
- hyperonym/basaran is primarily written in Python.
- How popular is basaran?
- hyperonym/basaran has 1.3k stars on GitHub.
- Where can I find basaran?
- hyperonym/basaran is on GitHub at https://github.com/hyperonym/basaran.