Distil-Whisper applies knowledge distillation to the Whisper model to produce smaller, faster variants optimized for English speech recognition. The project includes multiple model sizes (small through large-v3) with varying parameter counts and performance trade-offs. It provides training code and pre-trained model weights on HuggingFace for inference and fine-tuning.