← all repositories

liyucheng09/Selective_Context

A context compression library that allows LLMs to process twice the content with 40% less memory and GPU time.

Selective_Context
Velocity · 7d
+0.4
★ / day
Trend
steady
star history

Selective Context compresses prompt and conversation context by using a base language model to compute self-information scores for lexical units, retaining only the most informative content. It was published at EMNLP 2023 and includes evaluation on summarization, question answering, context reconstruction, and conversation tasks across arxiv papers, news articles, and transcripts. The tool is pip-installable and available as a Huggingface Space demo.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.