dkozlov/awesome-knowledge-distillation
A curated list of academic papers and resources on Knowledge Distillation, a deep learning model compression technique.
★3.9k stars Learning
Not currently ranked — collecting fresh signals.
star history
This repository aggregates foundational and recent research papers on Knowledge Distillation, covering techniques where smaller student models learn from larger teacher models. It includes seminal works by Geoffrey Hinton, Yoshua Bengio, and other researchers, spanning topics like dark knowledge, model compression, and transfer learning. The collection serves as a reference for ML practitioners and researchers studying model efficiency and knowledge transfer.
Frequently asked
- What is dkozlov/awesome-knowledge-distillation?
- A curated list of academic papers and resources on Knowledge Distillation, a deep learning model compression technique.
- Is awesome-knowledge-distillation open source?
- Yes — dkozlov/awesome-knowledge-distillation is open source, released under the Apache-2.0 license.
- How popular is awesome-knowledge-distillation?
- dkozlov/awesome-knowledge-distillation has 3.9k stars on GitHub.
- Where can I find awesome-knowledge-distillation?
- dkozlov/awesome-knowledge-distillation is on GitHub at https://github.com/dkozlov/awesome-knowledge-distillation.