← all repositories

Kyubyong/transformer

TensorFlow implementation of the Transformer architecture for German-to-English machine translation.

4.5k stars Python Language ModelsML Frameworks
transformer
Velocity · 7d
+1.4
★ / day
Trend
steady
star history

This repository provides a reference implementation of the Transformer model introduced in the 2017 paper Attention Is All You Need. It implements the encoder-decoder architecture with self-attention mechanisms for sequence-to-sequence tasks, specifically machine translation. The code uses TensorFlow 1.12 and trains on the IWSLT 2016 German-English parallel corpus with BPE tokenization, data preprocessing, and configurable hyperparameters.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.