liucongg/ChatGLM-Finetuning
A fine-tuning framework for ChatGLM-6B, ChatGLM2-6B, and ChatGLM3-6B models supporting Freeze, LoRA, P-tuning, and full-parameter methods.

This project implements various fine-tuning approaches for ChatGLM foundation models, including parameter freezing (Freeze), low-rank adaptation (LoRA), prefix tuning (P-tuning), and full-parameter fine-tuning. It supports single-GPU and multi-GPU training configurations with gradient checkpointing and zero optimization for memory efficiency. The repository focuses on downstream tasks such as information extraction, text generation, and classification.
Frequently asked
- What is liucongg/ChatGLM-Finetuning?
- A fine-tuning framework for ChatGLM-6B, ChatGLM2-6B, and ChatGLM3-6B models supporting Freeze, LoRA, P-tuning, and full-parameter methods.
- Is ChatGLM-Finetuning open source?
- Yes — liucongg/ChatGLM-Finetuning is an open-source project tracked on heatdrop.
- What language is ChatGLM-Finetuning written in?
- liucongg/ChatGLM-Finetuning is primarily written in Python.
- How popular is ChatGLM-Finetuning?
- liucongg/ChatGLM-Finetuning has 2.8k stars on GitHub.
- Where can I find ChatGLM-Finetuning?
- liucongg/ChatGLM-Finetuning is on GitHub at https://github.com/liucongg/ChatGLM-Finetuning.