This repository provides a reference implementation of the Transformer model in PyTorch, matching the original “Attention is All You Need” paper architecture. It supports training on standard NLP benchmarks including WMT32k (German-English translation) and lm1b datasets. Users can train the model and use a decoder script to translate sentences with a trained model.