mythrantic/ollama-docker
Docker Compose configuration for containerized deployment and execution of Ollama, an open-source large language model runtime.

Velocity · 7d
+1.6
★ / day
Trend
→steady
star history
This project provides Docker Compose files and configuration to simplify the deployment of Ollama, an open-source runtime for running large language models locally. It containerizes Ollama and its dependencies, handling the setup so users can launch LLM inference services via docker compose. The configuration also includes optional GPU passthrough for users with NVIDIA hardware who want accelerated inference performance.