← all repositories

haitongli/knowledge-distillation-pytorch

A PyTorch framework for knowledge distillation experiments on CIFAR-10 using teacher-student model training.

2k stars Python ML FrameworksComputer Vision
knowledge-distillation-pytorch
Velocity · 7d
+0.7
★ / day
Trend
steady
star history

This repository provides a PyTorch implementation for exploring knowledge distillation (KD) experiments on CIFAR-10. It implements a teacher-student training paradigm where a smaller student network learns from a larger pretrained teacher model (e.g., ResNet-18) using dark knowledge. The framework includes hyperparameter search utilities, tensorboard support, checkpoint management, and pretrained teacher models for download.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.