Baichuan-7B is a large-scale open-source pretrained language model developed by BaiChuan Inc. It is based on the Transformer architecture and was trained on approximately 1.2 trillion tokens. The model supports both Chinese and English, with a context window length of 4096 tokens. It achieves competitive performance among same-size models on standard Chinese and English benchmarks including C-Eval and MMLU.