← all repositories

nomic-ai/pygpt4all

Python bindings for running quantized LLMs via llama.cpp and GPT4All.

1k stars C++ Inference · Serving
pygpt4all
Velocity · 7d
+0.9
★ / day
Trend
steady
star history

Provides Python bindings to llama.cpp, enabling Python programs to run quantized large language models locally. GPT4All is an ecosystem of open-source models and tooling for running LLMs on consumer hardware without cloud dependencies. These bindings expose the underlying C++ inference engine to Python developers.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.