← all repositories

ymcui/Chinese-ELECTRA

Chinese ELECTRA pre-trained language model released by Harbin Institute of Technology and iFlytek (HFL).

1.4k stars Python Language Models
Chinese-ELECTRA
Velocity · 7d
+0.6
★ / day
Trend
steady
star history

This repository provides pre-trained Chinese ELECTRA models developed by the Harbin Institute of Technology and iFlytek joint lab (HFL). ELECTRA uses replaced token detection for pre-training rather than masked language modeling. The Chinese ELECTRA-small model achieves comparable performance to BERT-base while having only 1/10th the parameters. The models support both PyTorch and TensorFlow frameworks.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.