lucidrains/audiolm-pytorch
A PyTorch implementation of Google's AudioLM for neural audio generation and synthesis.

This repository provides a PyTorch implementation of AudioLM, Google’s state-of-the-art language modeling approach to audio generation. It leverages transformer architectures with attention mechanisms to model audio waveforms directly. The implementation extends AudioLM with classifier-free guidance using T5, enabling text-to-audio and text-to-speech capabilities similar to VALL-E. It also includes MIT-licensed SoundStream components and is compatible with Facebook’s EnCodec for neural audio compression.
Frequently asked
- What is lucidrains/audiolm-pytorch?
- A PyTorch implementation of Google's AudioLM for neural audio generation and synthesis.
- Is audiolm-pytorch open source?
- Yes — lucidrains/audiolm-pytorch is open source, released under the MIT license.
- What language is audiolm-pytorch written in?
- lucidrains/audiolm-pytorch is primarily written in Python.
- How popular is audiolm-pytorch?
- lucidrains/audiolm-pytorch has 2.6k stars on GitHub.
- Where can I find audiolm-pytorch?
- lucidrains/audiolm-pytorch is on GitHub at https://github.com/lucidrains/audiolm-pytorch.