← all repositories

tatp22/multidim-positional-encoding

A Python library providing 1D, 2D, and 3D sinusoidal positional encoding implementations for PyTorch and TensorFlow.

615 stars Python ML Frameworks
multidim-positional-encoding
Velocity · 7d
+0.3
★ / day
Trend
steady
star history

This library implements sinusoidal positional encodings for deep learning models, supporting PyTorch and TensorFlow. It provides PositionalEncoding1D, PositionalEncoding2D, and PositionalEncoding3D classes along with a Summer class to add encodings to input tensors. The encodings work on tensors of various shapes and are a key building block for transformer-based architectures.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.