This repository provides GPT-2 adapted for multiple languages, with a focus on Chinese. It includes 1.5 billion parameter pretrained Chinese language models trained on large corpora (~15G and ~30G text), along with training scripts supporting TPU execution based on Grover, and ported BERT tokenizers for multilingual compatibility. The project offers ready-to-use Colab demos for model inference.