AberHu/Knowledge-Distillation-Zoo
A PyTorch library of knowledge distillation methods for model compression and teacher-student knowledge transfer.
Not currently ranked — collecting fresh signals.
star history
This repository provides PyTorch implementations of various knowledge distillation techniques used to compress neural networks. It includes classic methods like soft targets, attention transfer, Fitnet hints, and probabilistic knowledge transfer. The library enables training smaller student models to mimic larger teacher models, reducing model size and computational cost while preserving predictive performance.
Frequently asked
- What is AberHu/Knowledge-Distillation-Zoo?
- A PyTorch library of knowledge distillation methods for model compression and teacher-student knowledge transfer.
- Is Knowledge-Distillation-Zoo open source?
- Yes — AberHu/Knowledge-Distillation-Zoo is an open-source project tracked on heatdrop.
- What language is Knowledge-Distillation-Zoo written in?
- AberHu/Knowledge-Distillation-Zoo is primarily written in Python.
- How popular is Knowledge-Distillation-Zoo?
- AberHu/Knowledge-Distillation-Zoo has 1.7k stars on GitHub.
- Where can I find Knowledge-Distillation-Zoo?
- AberHu/Knowledge-Distillation-Zoo is on GitHub at https://github.com/AberHu/Knowledge-Distillation-Zoo.