rustformers/llm
A Rust library ecosystem for running and inference of large language models using GGML tensors.

Velocity · 7d
+5.2
★ / day
Trend
→steady
star history
This repository provided Rust libraries for working with large language models, offering abstractions for loading and running various LLM architectures via GGML-based inference. It was designed as a pure-Rust ML inference framework for LLMs. The project has been archived and maintainers recommend alternatives like Ratchet, Hugging Face Candle-based libraries, and llama.cpp wrappers for continued development.