tatp22/multidim-positional-encoding
A Python library providing 1D, 2D, and 3D sinusoidal positional encoding implementations for PyTorch and TensorFlow.

Velocity · 7d
+0.3
★ / day
Trend
→steady
star history
This library implements sinusoidal positional encodings for deep learning models, supporting PyTorch and TensorFlow. It provides PositionalEncoding1D, PositionalEncoding2D, and PositionalEncoding3D classes along with a Summer class to add encodings to input tensors. The encodings work on tensors of various shapes and are a key building block for transformer-based architectures.