yangjianxin1/Firefly-LLaMA2-Chinese
Chinese LLaMA-2 large language model with vocabulary expansion and incremental pre-training support.
Not currently ranked — collecting fresh signals.
star history
Firefly-LLaMA2-Chinese is a bilingual Chinese-English LLM built on LLaMA-2 with Chinese vocabulary expansion. The project supports incremental pre-training of multiple model architectures (Baichuan2, Qwen, InternLM, Falcon, etc.) using QLoRA/LoRA techniques for low-resource training. It performs both continued pre-training and instruction fine-tuning on Chinese-English dialogue data, then evaluates on Open LLM Leaderboard and CMMLU benchmarks.
Frequently asked
- What is yangjianxin1/Firefly-LLaMA2-Chinese?
- Chinese LLaMA-2 large language model with vocabulary expansion and incremental pre-training support.
- Is Firefly-LLaMA2-Chinese open source?
- Yes — yangjianxin1/Firefly-LLaMA2-Chinese is an open-source project tracked on heatdrop.
- What language is Firefly-LLaMA2-Chinese written in?
- yangjianxin1/Firefly-LLaMA2-Chinese is primarily written in Python.
- How popular is Firefly-LLaMA2-Chinese?
- yangjianxin1/Firefly-LLaMA2-Chinese has 414 stars on GitHub.
- Where can I find Firefly-LLaMA2-Chinese?
- yangjianxin1/Firefly-LLaMA2-Chinese is on GitHub at https://github.com/yangjianxin1/Firefly-LLaMA2-Chinese.