KakaoBrain’s KoGPT is a Korean-specific large language model based on the GPT architecture with 6.1 billion parameters. The model follows the transformer architecture with 28 layers, 4096 hidden dimensions, and 16 attention heads. It is hosted on HuggingFace with both full-precision and float16 versions available for inference.