mozilla-ai/llamafile
A framework that packages LLMs and speech-to-text models into portable single-file executables.

Velocity · 7d
+25
★ / day
Trend
→steady
star history
llamafile enables local distribution and execution of open LLMs and speech-to-text models through single-file executables. It combines llama.cpp for LLM inference and whisper.cpp for speech recognition with Cosmopolitan Libc to create portable binaries that run across operating systems and CPU architectures without installation. The project also includes whisperfile, a speech-to-text tool built on whisper.cpp.