FLHonker/Awesome-Knowledge-Distillation
Curated collection of 658 papers on knowledge distillation, organized by technique type including logits, intermediate layers, GANs, RL, and self-supervised learning.
Not currently ranked — collecting fresh signals.
star history
This repository categorizes academic papers on knowledge distillation from 2014 to 2021, covering various forms of knowledge transfer including logits-based, intermediate layer-based, graph-based, and structural knowledge approaches. It also includes applications of knowledge distillation combined with other techniques such as GANs, meta-learning, reinforcement learning, and AutoML. The collection serves as a reference for model compression and efficient training methodologies in deep learning.
Frequently asked
- What is FLHonker/Awesome-Knowledge-Distillation?
- Curated collection of 658 papers on knowledge distillation, organized by technique type including logits, intermediate layers, GANs, RL, and self-supervised learning.
- Is Awesome-Knowledge-Distillation open source?
- Yes — FLHonker/Awesome-Knowledge-Distillation is an open-source project tracked on heatdrop.
- How popular is Awesome-Knowledge-Distillation?
- FLHonker/Awesome-Knowledge-Distillation has 2.7k stars on GitHub.
- Where can I find Awesome-Knowledge-Distillation?
- FLHonker/Awesome-Knowledge-Distillation is on GitHub at https://github.com/FLHonker/Awesome-Knowledge-Distillation.