evilsocket/cake
A distributed multimodal AI inference server written in Rust supporting text, image, and voice synthesis models across heterogeneous clusters.
Not currently ranked — collecting fresh signals.
star history
Cake is a Rust-based inference server that runs AI models either on a single node or sharded across a heterogeneous cluster of devices spanning iOS, Android, macOS, Linux, and Windows. It supports multiple modality types including text generation, image generation via Stable Diffusion and FLUX, and voice synthesis with VibeVoice TTS including voice cloning. The system auto-detects model architectures from HuggingFace checkpoints and provides an OpenAI-compatible API.
Frequently asked
- What is evilsocket/cake?
- A distributed multimodal AI inference server written in Rust supporting text, image, and voice synthesis models across heterogeneous clusters.
- Is cake open source?
- Yes — evilsocket/cake is an open-source project tracked on heatdrop.
- What language is cake written in?
- evilsocket/cake is primarily written in Rust.
- How popular is cake?
- evilsocket/cake has 3.1k stars on GitHub.
- Where can I find cake?
- evilsocket/cake is on GitHub at https://github.com/evilsocket/cake.