ssbuild/chatglm_finetuning
Fine-tuning framework for ChatGLM and similar large language models using various parameter-efficient training techniques.
Not currently ranked — collecting fresh signals.
star history
This repository provides tools and implementations for fine-tuning ChatGLM models, including support for GLM-4 variants. It supports multiple fine-tuning methods such as LoRA, QLoRA, AdaLoRA, IA3, and P-tuning v2, enabling efficient training of large language models with reduced computational overhead. The framework integrates with transformers, DeepSpeed, and bitsandbytes for distributed training and quantization support.
Frequently asked
- What is ssbuild/chatglm_finetuning?
- Fine-tuning framework for ChatGLM and similar large language models using various parameter-efficient training techniques.
- Is chatglm_finetuning open source?
- Yes — ssbuild/chatglm_finetuning is open source, released under the Apache-2.0 license.
- What language is chatglm_finetuning written in?
- ssbuild/chatglm_finetuning is primarily written in Python.
- How popular is chatglm_finetuning?
- ssbuild/chatglm_finetuning has 1.5k stars on GitHub.
- Where can I find chatglm_finetuning?
- ssbuild/chatglm_finetuning is on GitHub at https://github.com/ssbuild/chatglm_finetuning.