PhoBERT delivers state-of-the-art monolingual language models for Vietnamese, trained following the RoBERTa approach with improved BERT pre-training procedures. It provides both base and large model variants accessible through Hugging Face transformers and fairseq libraries. The models achieve top performance on Vietnamese downstream tasks including part-of-speech tagging, named-entity recognition, dependency parsing, and natural language inference.