This repository provides PyTorch implementations of various knowledge distillation techniques used to compress neural networks. It includes classic methods like soft targets, attention transfer, Fitnet hints, and probabilistic knowledge transfer. The library enables training smaller student models to mimic larger teacher models, reducing model size and computational cost while preserving predictive performance.