← all repositories

qnguyen3/chat-with-mlx

A local chat playground UI for running open-source LLMs on Apple Silicon using the MLX framework.

1.6k stars Python Chat AssistantsRAG · Search
chat-with-mlx
Velocity · 7d
+1.9
★ / day
Trend
steady
star history

Chat with MLX provides a graphical interface for running and chatting with open-source language models on Apple Silicon Macs. It leverages Apple’s MLX framework for efficient on-device inference and supports models including Llama-3, Phi-3, Mistral, and others. The application includes document indexing capabilities for RAG-style interactions with local files and YouTube content.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.