ymcui/Chinese-ELECTRA
Chinese ELECTRA pre-trained language model released by Harbin Institute of Technology and iFlytek (HFL).

Velocity · 7d
+0.6
★ / day
Trend
→steady
star history
This repository provides pre-trained Chinese ELECTRA models developed by the Harbin Institute of Technology and iFlytek joint lab (HFL). ELECTRA uses replaced token detection for pre-training rather than masked language modeling. The Chinese ELECTRA-small model achieves comparable performance to BERT-base while having only 1/10th the parameters. The models support both PyTorch and TensorFlow frameworks.