Tebmer/Awesome-Knowledge-Distillation-of-LLMs
A curated list of academic papers surveying knowledge distillation techniques and algorithms for compressing and training efficient large language models.

This repository aggregates research papers on knowledge distillation of LLMs, organized around a formal survey framework. It covers knowledge elicitation methods, distillation algorithms, and skill or vertical distillation approaches for compressing large language models into smaller, efficient variants. The project serves as a weekly-updated academic resource for researchers studying LLM compression and efficient deployment.