← all repositories

mythrantic/ollama-docker

Docker Compose configuration for containerized deployment and execution of Ollama, an open-source large language model runtime.

1.4k stars HTML Inference · Serving
ollama-docker
Velocity · 7d
+1.6
★ / day
Trend
steady
star history

This project provides Docker Compose files and configuration to simplify the deployment of Ollama, an open-source runtime for running large language models locally. It containerizes Ollama and its dependencies, handling the setup so users can launch LLM inference services via docker compose. The configuration also includes optional GPU passthrough for users with NVIDIA hardware who want accelerated inference performance.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.