Tebmer/Awesome-Knowledge-Distillation-of-LLMs
A curated list of academic papers surveying knowledge distillation techniques and algorithms for compressing and training efficient large language models.
Not currently ranked — collecting fresh signals.
star history
This repository aggregates research papers on knowledge distillation of LLMs, organized around a formal survey framework. It covers knowledge elicitation methods, distillation algorithms, and skill or vertical distillation approaches for compressing large language models into smaller, efficient variants. The project serves as a weekly-updated academic resource for researchers studying LLM compression and efficient deployment.
Frequently asked
- What is Tebmer/Awesome-Knowledge-Distillation-of-LLMs?
- A curated list of academic papers surveying knowledge distillation techniques and algorithms for compressing and training efficient large language models.
- Is Awesome-Knowledge-Distillation-of-LLMs open source?
- Yes — Tebmer/Awesome-Knowledge-Distillation-of-LLMs is an open-source project tracked on heatdrop.
- How popular is Awesome-Knowledge-Distillation-of-LLMs?
- Tebmer/Awesome-Knowledge-Distillation-of-LLMs has 1.3k stars on GitHub.
- Where can I find Awesome-Knowledge-Distillation-of-LLMs?
- Tebmer/Awesome-Knowledge-Distillation-of-LLMs is on GitHub at https://github.com/Tebmer/Awesome-Knowledge-Distillation-of-LLMs.