This repository contains Jupyter Notebook recipes that enable developers to pretrain BERT language representation models from scratch on a corpus, as well as fine-tune existing BERT models for specialized NLP tasks like text classification, named entity recognition, and question answering. The notebooks leverage Azure Machine Learning service as the training infrastructure and use PyTorch as the deep learning framework.