ray-project/ray-llm
Ray LLM served its purpose, then moved upstairs
An archived collection of LLM-serving tools that were upstreamed into the core Ray project.
Not currently ranked — collecting fresh signals.
star history
What it does
This repository previously hosted tools for deploying large language models on Ray, but it is now archived and unmaintained. Its capabilities were upstreamed into the main Ray distribution as the ray.serve.llm and ray.data.llm modules, reducing this repo to a historical signpost.
The interesting bit
The project was deliberately sunset after its APIs were upstreamed into the main Ray distribution. The full history survives in the archived-master branch for anyone interested in the provenance.
Key highlights
- Archived and no longer maintained
- LLM APIs now live in the core Ray project as
ray.serve.llmandray.data.llm - Upstreamed code is managed directly by the Ray team
- Original history preserved in the
archived-masterbranch
Verdict
Browse the archived-master branch if you care about provenance; otherwise, look to the main Ray repository’s integrated LLM APIs for current work.
Frequently asked
- What is ray-project/ray-llm?
- An archived collection of LLM-serving tools that were upstreamed into the core Ray project.
- Is ray-llm open source?
- Yes — ray-project/ray-llm is an open-source project tracked on heatdrop.
- How popular is ray-llm?
- ray-project/ray-llm has 1.3k stars on GitHub.
- Where can I find ray-llm?
- ray-project/ray-llm is on GitHub at https://github.com/ray-project/ray-llm.