← all repositories

rustformers/llm

A Rust library ecosystem for running and inference of large language models using GGML tensors.

llm
Velocity · 7d
+5.2
★ / day
Trend
steady
star history

This repository provided Rust libraries for working with large language models, offering abstractions for loading and running various LLM architectures via GGML-based inference. It was designed as a pure-Rust ML inference framework for LLMs. The project has been archived and maintainers recommend alternatives like Ratchet, Hugging Face Candle-based libraries, and llama.cpp wrappers for continued development.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.