← all repositories

pepperoni21/ollama-rs

A Rust client library for the Ollama local LLM inference engine API.

1k stars Rust Inference · Serving
ollama-rs
Velocity · 7d
+1.1
★ / day
Trend
steady
star history

This library provides a Rust interface to interact with Ollama, a local LLM inference runtime. It covers the full Ollama API including completion generation, chat mode, embedding generation, and model lifecycle management such as creating, copying, and deleting models. The library supports streaming responses, function calling, and advanced options like thinking mode for supported models.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.