lone-cloud/gerbil
A cross-platform desktop app that runs language and image generation models locally on user hardware.

Velocity · 7d
+1.5
★ / day
Trend
→steady
star history
Gerbil is a desktop application for locally running large language models and image generation models. It uses KoboldCpp (a llama.cpp fork) for LLM inference with support for CUDA, ROCm, Vulkan, and Metal acceleration. The app includes built-in presets for Flux, Chroma, Qwen Image, and Z-Image workflows, integrates with HuggingFace for model browsing and downloading GGUF files, and can launch SillyTavern and OpenWebUI for extended interaction capabilities.