0nutation/SpeechGPT
SpeechGPT is a series of research projects developing large language models capable of perceiving and generating speech audio.

Not currently ranked — collecting fresh signals.
star history
The repository hosts multiple speech LLM research projects including SpeechGPT (cross-modal conversational LLMs), SpeechGPT-Gen (chain-of-information speech generation), SpeechAgents (multi-modal multi-agent systems), and SpeechTokenizer (unified speech tokenization). These projects explore integrating speech/audio modalities into LLM architectures for enhanced conversational and generative capabilities.
Frequently asked
- What is 0nutation/SpeechGPT?
- SpeechGPT is a series of research projects developing large language models capable of perceiving and generating speech audio.
- Is SpeechGPT open source?
- Yes — 0nutation/SpeechGPT is open source, released under the Apache-2.0 license.
- What language is SpeechGPT written in?
- 0nutation/SpeechGPT is primarily written in Python.
- How popular is SpeechGPT?
- 0nutation/SpeechGPT has 1.4k stars on GitHub.
- Where can I find SpeechGPT?
- 0nutation/SpeechGPT is on GitHub at https://github.com/0nutation/SpeechGPT.