← all repositories

jncraton/languagemodels

A Python library enabling local large language model inference with as little as 512MB of RAM.

languagemodels
Velocity · 7d
+1.1
★ / day
Trend
steady
star history

This package provides Python building blocks for exploring large language models locally. It handles model downloading, caching, and inference with a simple API. Users can perform tasks like instruction following, translation, and question answering with minimal resource requirements while keeping data private by default.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.