llama-farm/llamafarm
An open-source AI platform that enables local deployment of models, RAG systems, and pipelines with automatic hardware acceleration.

LlamaFarm is an open-source AI platform that runs entirely on local hardware, supporting deployment of various LLM models including Llama, Gemma, Mistral, and Qwen. It provides capabilities for building RAG applications, training custom classifiers, and running document processing pipelines. The platform includes automatic GPU/NPU acceleration for Apple Silicon, NVIDIA, and AMD hardware, and offers desktop applications for Mac, Windows, and Linux.