hyunwoongko/transformer
A PyTorch implementation of the Transformer architecture for sequence-to-sequence tasks such as machine translation.

Velocity · 7d
+1.9
★ / day
Trend
→steady
star history
This repository contains an implementation of the Transformer model as described in the 2017 ‘Attention Is All You Need’ paper by Google Brain. The implementation includes key components such as positional encoding, multi-head self-attention, and the encoder-decoder architecture. It is designed for sequence-to-sequence tasks like neural machine translation.