October2001/Awesome-KV-Cache-Compression
An actively maintained collection of research papers on KV Cache Compression techniques for optimizing large language model inference.
Not currently ranked — collecting fresh signals.
star history
This repository aggregates academic papers on KV Cache Compression, a set of methods for reducing the memory and computational overhead of attention mechanisms in transformers. It includes implementations like kvpress and KVCache-Factory, benchmarks, and survey papers. The list is continuously updated as the field progresses.
Frequently asked
- What is October2001/Awesome-KV-Cache-Compression?
- An actively maintained collection of research papers on KV Cache Compression techniques for optimizing large language model inference.
- Is Awesome-KV-Cache-Compression open source?
- Yes — October2001/Awesome-KV-Cache-Compression is open source, released under the MIT license.
- How popular is Awesome-KV-Cache-Compression?
- October2001/Awesome-KV-Cache-Compression has 726 stars on GitHub.
- Where can I find Awesome-KV-Cache-Compression?
- October2001/Awesome-KV-Cache-Compression is on GitHub at https://github.com/October2001/Awesome-KV-Cache-Compression.