← all repositories

hyunwoongko/transformer

A PyTorch implementation of the Transformer architecture for sequence-to-sequence tasks such as machine translation.

4.6k stars Python Language ModelsML Frameworks
transformer
Velocity · 7d
+1.9
★ / day
Trend
steady
star history

This repository contains an implementation of the Transformer model as described in the 2017 ‘Attention Is All You Need’ paper by Google Brain. The implementation includes key components such as positional encoding, multi-head self-attention, and the encoder-decoder architecture. It is designed for sequence-to-sequence tasks like neural machine translation.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.