← all repositories

Tebmer/Awesome-Knowledge-Distillation-of-LLMs

A curated list of academic papers surveying knowledge distillation techniques and algorithms for compressing and training efficient large language models.

Awesome-Knowledge-Distillation-of-LLMs
Velocity · 7d
+1.5
★ / day
Trend
steady
star history

This repository aggregates research papers on knowledge distillation of LLMs, organized around a formal survey framework. It covers knowledge elicitation methods, distillation algorithms, and skill or vertical distillation approaches for compressing large language models into smaller, efficient variants. The project serves as a weekly-updated academic resource for researchers studying LLM compression and efficient deployment.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.