jncraton/languagemodels
A Python library enabling local large language model inference with as little as 512MB of RAM.

Velocity · 7d
+1.1
★ / day
Trend
→steady
star history
This package provides Python building blocks for exploring large language models locally. It handles model downloading, caching, and inference with a simple API. Users can perform tasks like instruction following, translation, and question answering with minimal resource requirements while keeping data private by default.