← all repositories

yxuansu/SimCTG

A contrastive decoding method for improving text generation quality from neural language models.

SimCTG
Velocity · 7d
+0.3
★ / day
Trend
steady
star history

This repository provides the code and models for a contrastive framework for neural text generation, presented at NeurIPS 2022. The method improves decoding strategies for language models by leveraging contrastive learning principles during generation. It offers an alternative to standard greedy or beam search decoding, addressing issues like repetition and low-quality outputs. The project integrates with Huggingface transformers for easy adoption.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.