Evil0ctal/Fast-Powerful-Whisper-AI-Services-API
An asynchronous API service that runs Whisper models locally for automatic speech recognition and translation with multi-GPU support.

The project provides a high-performance, distributed API for automatic speech recognition using OpenAI’s Whisper model and its faster variant. It leverages an async producer-consumer architecture with a thread pool for multi-GPU parallel inference, enabling scalable transcription and translation workflows. Integrated crawlers automate fetching audio from social platforms like Douyin and TikTok into the pipeline. Future plans include LLM integration (e.g., ChatGPT) to extend beyond transcription into natural language processing.
Frequently asked
- What is Evil0ctal/Fast-Powerful-Whisper-AI-Services-API?
- An asynchronous API service that runs Whisper models locally for automatic speech recognition and translation with multi-GPU support.
- Is Fast-Powerful-Whisper-AI-Services-API open source?
- Yes — Evil0ctal/Fast-Powerful-Whisper-AI-Services-API is open source, released under the Apache-2.0 license.
- What language is Fast-Powerful-Whisper-AI-Services-API written in?
- Evil0ctal/Fast-Powerful-Whisper-AI-Services-API is primarily written in Python.
- How popular is Fast-Powerful-Whisper-AI-Services-API?
- Evil0ctal/Fast-Powerful-Whisper-AI-Services-API has 470 stars on GitHub.
- Where can I find Fast-Powerful-Whisper-AI-Services-API?
- Evil0ctal/Fast-Powerful-Whisper-AI-Services-API is on GitHub at https://github.com/Evil0ctal/Fast-Powerful-Whisper-AI-Services-API.