haitongli/knowledge-distillation-pytorch
A PyTorch framework for knowledge distillation experiments on CIFAR-10 using teacher-student model training.

Velocity · 7d
+0.7
★ / day
Trend
→steady
star history
This repository provides a PyTorch implementation for exploring knowledge distillation (KD) experiments on CIFAR-10. It implements a teacher-student training paradigm where a smaller student network learns from a larger pretrained teacher model (e.g., ResNet-18) using dark knowledge. The framework includes hyperparameter search utilities, tensorboard support, checkpoint management, and pretrained teacher models for download.