nomic-ai/pygpt4all
Python bindings for running quantized LLMs via llama.cpp and GPT4All.

Velocity · 7d
+0.9
★ / day
Trend
→steady
star history
Provides Python bindings to llama.cpp, enabling Python programs to run quantized large language models locally. GPT4All is an ecosystem of open-source models and tooling for running LLMs on consumer hardware without cloud dependencies. These bindings expose the underlying C++ inference engine to Python developers.