ProtTrans provides state-of-the-art pre-trained transformer models for protein sequences, trained at scale on GPU and TPU clusters. The repository offers feature extraction, logits extraction, fine-tuning, prediction, and protein sequence generation capabilities. It supports the bioinformatics community including COVID-19 research through transfer learning from protein language models.