withcatai/catai
A Node.js package for running GGUF-based AI assistant models locally with a built-in chat UI and CLI.
Not currently ranked — collecting fresh signals.
star history
Catai provides a command-line interface and web chat UI for running GGUF-format language models locally on your machine. It wraps node-llama-cpp (which itself wraps llama.cpp) to handle model loading, inference, and streaming in a Node.js environment. Users can install models from a curated list, switch between them, and interact via a real-time streaming chat interface.
Frequently asked
- What is withcatai/catai?
- A Node.js package for running GGUF-based AI assistant models locally with a built-in chat UI and CLI.
- Is catai open source?
- Yes — withcatai/catai is open source, released under the MIT license.
- What language is catai written in?
- withcatai/catai is primarily written in TypeScript.
- How popular is catai?
- withcatai/catai has 496 stars on GitHub.
- Where can I find catai?
- withcatai/catai is on GitHub at https://github.com/withcatai/catai.