xusenlinzy/api-for-open-llm
Unified OpenAI-style API gateway for serving multiple open-source LLMs including LLaMA, ChatGLM, Qwen, and CodeLLaMA.
Not currently ranked — collecting fresh signals.
star history
This project provides a REST API interface that wraps open-source large language models, offering OpenAI-compatible endpoints for inference. It supports a wide range of models including LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, ChatGLM variants, CodeLLaMA, and SQLCoder. The project includes Docker deployment support and integrates with langchain for building LLM applications.
Frequently asked
- What is xusenlinzy/api-for-open-llm?
- Unified OpenAI-style API gateway for serving multiple open-source LLMs including LLaMA, ChatGLM, Qwen, and CodeLLaMA.
- Is api-for-open-llm open source?
- Yes — xusenlinzy/api-for-open-llm is open source, released under the Apache-2.0 license.
- What language is api-for-open-llm written in?
- xusenlinzy/api-for-open-llm is primarily written in Python.
- How popular is api-for-open-llm?
- xusenlinzy/api-for-open-llm has 2.5k stars on GitHub.
- Where can I find api-for-open-llm?
- xusenlinzy/api-for-open-llm is on GitHub at https://github.com/xusenlinzy/api-for-open-llm.