An open-source Suno rival you can actually run at home
HeartMuLa ships a full lyrics-to-song stack — generator, codec, transcriber, and retrieval model — under Apache 2.0.

What it does
HeartMuLa is a family of music foundation models: a 3B music language model that generates full songs conditioned on lyrics and style tags (with multilingual lyric support), plus HeartCodec, a 12.5 Hz neural codec that reconstructs 48 kHz stereo audio. The family also includes HeartTranscriptor, a Whisper-based lyrics transcriber, and HeartCLAP, an audio–text alignment model for cross-modal retrieval. A sibling project, MuLaCover, does controllable cover songs and remixes from reference audio or MIDI.
The interesting bit
The team applied reinforcement learning to the generator for tighter style and tag control — a technique more associated with chatbots than choruses. They also released the HeartBeats benchmark, a multilingual, multi-genre evaluation set for comparing music models fairly, which the field genuinely lacked.
Key highlights
- Apache 2.0 license on code and all released weights
- Claims the internal 7B version performs comparably to Suno on musicality, fidelity, and controllability
- Comma-separated tags (e.g.
piano,happy,wedding) drive genre and mood; lyrics use section markers like[Verse]and[Chorus] - Runs locally with multi-GPU splitting (
--mula_device/--codec_device) and a--lazy_loadmode for single-GPU setups - Community ComfyUI node exists, plus hosted demos on Hugging Face and ModelScope
Caveats
- The 7B model is not released yet — only the 3B is available, and the Suno comparison applies to the internal 7B
- Inference is slow: real-time factor around 1.0, with acceleration and streaming scripts still on the TODO list
- Reference-audio conditioning and fine-grained control are listed as future work
Verdict
Worth a look if you want a self-hosted, permissively licensed text-to-music pipeline or a research base for music generation. If you need Suno-grade output today, the open 3B isn’t there yet — and you’ll want a serious GPU.
Frequently asked
- What is HeartMuLa/heartlib?
- HeartMuLa ships a full lyrics-to-song stack — generator, codec, transcriber, and retrieval model — under Apache 2.0.
- Is heartlib open source?
- Yes — HeartMuLa/heartlib is open source, released under the Apache-2.0 license.
- What language is heartlib written in?
- HeartMuLa/heartlib is primarily written in Python.
- How popular is heartlib?
- HeartMuLa/heartlib has 3.8k stars on GitHub.
- Where can I find heartlib?
- HeartMuLa/heartlib is on GitHub at https://github.com/HeartMuLa/heartlib.