This repository provides a PyTorch implementation of the Non-local Neural Network block from the 2017 paper. It includes multiple variants of the attention mechanism (Gaussian, embedded Gaussian, concatenation, dot product) and supports automatic mixed precision training. The project includes training scripts for MNIST and tools to visualize non-local attention maps.