← all repositories

withcatai/catai

A Node.js package for running GGUF-based AI assistant models locally with a built-in chat UI and CLI.

catai
Velocity · 7d
+0.4
★ / day
Trend
steady
star history

Catai provides a command-line interface and web chat UI for running GGUF-format language models locally on your machine. It wraps node-llama-cpp (which itself wraps llama.cpp) to handle model loading, inference, and streaming in a Node.js environment. Users can install models from a curated list, switch between them, and interact via a real-time streaming chat interface.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.