microsoft/SpeechT5
Microsoft's unified-modal speech-text pre-training framework implementing multiple speech processing models including ASR, TTS, speech translation, and speech language models.

SpeechT5 provides pre-training approaches for spoken language processing including SpeechT5 (encoder-decoder pre-training), Speech2C (ASR with unpaired speech), YiTrans (speech translation), SpeechUT (speech-text bridging), and VALL-E X (cross-lingual neural codec language modeling). The repository contains model implementations, evaluation results, and inference instructions for these speech-focused deep learning systems.
Frequently asked
- What is microsoft/SpeechT5?
- Microsoft's unified-modal speech-text pre-training framework implementing multiple speech processing models including ASR, TTS, speech translation, and speech language models.
- Is SpeechT5 open source?
- Yes — microsoft/SpeechT5 is open source, released under the MIT license.
- What language is SpeechT5 written in?
- microsoft/SpeechT5 is primarily written in Python.
- How popular is SpeechT5?
- microsoft/SpeechT5 has 1.4k stars on GitHub.
- Where can I find SpeechT5?
- microsoft/SpeechT5 is on GitHub at https://github.com/microsoft/SpeechT5.