withcatai/catai
A Node.js package for running GGUF-based AI assistant models locally with a built-in chat UI and CLI.

Velocity · 7d
+0.4
★ / day
Trend
→steady
star history
Catai provides a command-line interface and web chat UI for running GGUF-format language models locally on your machine. It wraps node-llama-cpp (which itself wraps llama.cpp) to handle model loading, inference, and streaming in a Node.js environment. Users can install models from a curated list, switch between them, and interact via a real-time streaming chat interface.