liyucheng09/Selective_Context
A context compression library that allows LLMs to process twice the content with 40% less memory and GPU time.

Velocity · 7d
+0.4
★ / day
Trend
→steady
star history
Selective Context compresses prompt and conversation context by using a base language model to compute self-information scores for lexical units, retaining only the most informative content. It was published at EMNLP 2023 and includes evaluation on summarization, question answering, context reconstruction, and conversation tasks across arxiv papers, news articles, and transcripts. The tool is pip-installable and available as a Huggingface Space demo.