This repository provides implementations of various self-attention building blocks for computer vision tasks in PyTorch. It includes modules such as multi-head self-attention, axial attention, and transformer encoders, implemented using einsum and einops for efficient computation. The library is designed as reusable components that can be integrated into larger vision models.