soulteary/docker-llama2-chat
A Docker-based project enabling local LLaMA2 model deployment in three steps with support for GPU, CPU inference, and quantized variants.
Not currently ranked — collecting fresh signals.
star history
The repository provides Docker configurations and tooling to run LLaMA2 models locally without heavy setup. It supports official Meta LLaMA2 (7B/13B), Chinese-adapted variants, and quantized versions via llama.cpp/GGML. Users can run models on GPU (8-14GB vRAM), with Transformers quantization (5GB vRAM), or CPU-only using llama.cpp.
Frequently asked
- What is soulteary/docker-llama2-chat?
- A Docker-based project enabling local LLaMA2 model deployment in three steps with support for GPU, CPU inference, and quantized variants.
- Is docker-llama2-chat open source?
- Yes — soulteary/docker-llama2-chat is open source, released under the Apache-2.0 license.
- What language is docker-llama2-chat written in?
- soulteary/docker-llama2-chat is primarily written in Python.
- How popular is docker-llama2-chat?
- soulteary/docker-llama2-chat has 534 stars on GitHub.
- Where can I find docker-llama2-chat?
- soulteary/docker-llama2-chat is on GitHub at https://github.com/soulteary/docker-llama2-chat.