← all repositories

addyosmani/chatty

A privacy-focused in-browser AI chat application that runs large language models locally using WebGPU.

822 stars TypeScript Chat AssistantsInference · Serving
chatty
Velocity · 7d
+1.1
★ / day
Trend
steady
star history

Chatty is a client-side AI chatbot that leverages WebGPU to run LLMs entirely in the browser without server-side processing. It supports popular open-source models including Gemma, Llama 2 and 3, and Mistral, enabling offline usage after initial model download. The application includes file-based question answering using local embeddings with MemoryVectorStore, markdown rendering, code highlighting, conversation history management, and custom memory instructions.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.