← all repositories

Beomi/KoAlpaca

A Korean-language instruction-following LLM built on LLaMA/Alpaca with QLoRA fine-tuning support.

1.6k stars Jupyter Notebook Language ModelsML Frameworks
KoAlpaca
Not currently ranked — collecting fresh signals.
star history

KoAlpaca is an open-source language model designed to understand and respond to Korean instructions. The model is a fine-tuned version of Polyglot-ko and LLaMA architectures, supporting parameter-efficient fine-tuning methods like QLoRA and LoRA through PEFT. Model weights are distributed via HuggingFace, and training examples including tensor parallel multi-GPU fine-tuning are provided as Colab notebooks.

Frequently asked

What is Beomi/KoAlpaca?
A Korean-language instruction-following LLM built on LLaMA/Alpaca with QLoRA fine-tuning support.
Is KoAlpaca open source?
Yes — Beomi/KoAlpaca is open source, released under the Apache-2.0 license.
What language is KoAlpaca written in?
Beomi/KoAlpaca is primarily written in Jupyter Notebook.
How popular is KoAlpaca?
Beomi/KoAlpaca has 1.6k stars on GitHub.
Where can I find KoAlpaca?
Beomi/KoAlpaca is on GitHub at https://github.com/Beomi/KoAlpaca.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.