alibaba/EasyTransfer
A deep transfer learning platform for NLP applications developed by Alibaba, supporting pre-trained language models and knowledge distillation.

EasyTransfer is a production-grade NLP toolkit developed at Alibaba that enables users to pre-train and fine-tune language models such as BERT, ALBERT, RoBERTa, and T5. It provides ModelZoo with pre-trained models and AppZoo with pre-built NLP applications like text matching and machine reading comprehension. The platform also supports knowledge distillation for compressing large models and includes tools for training, evaluation, offline prediction, and online deployment.