bert4torch is a PyTorch-based framework implementing transformer models for natural language processing. It supports loading and fine-tuning major open-source LLMs including ChatGLM, LLaMA, and BERT variants. The library covers common NLP tasks such as named-entity recognition, text classification, relation extraction, and sequence-to-sequence generation, offering both training and deployment capabilities.