← all repositories

THUDM/P-tuning

A method for parameter-efficient fine-tuning of large language models using trainable continuous prompt embeddings.

939 stars Python Language ModelsML Frameworks
P-tuning
Velocity · 7d
+0.5
★ / day
Trend
steady
star history

P-tuning is a parameter-efficient fine-tuning technique for pre-trained language models. It introduces learnable continuous embeddings as trainable prompts while keeping most model parameters frozen. The approach enables effective adaptation of large language models like GPT to downstream tasks with fewer trainable parameters, supporting few-shot learning scenarios. The repository includes code and datasets for LAMA and SuperGLUE benchmarks.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.