This repository re-implements the MoCo v3 self-supervised contrastive learning algorithm in PyTorch for GPU training. It supports pre-training ResNet and Vision Transformer architectures on ImageNet-1k using various batch sizes, followed by linear evaluation or end-to-end fine-tuning. The implementation reproduces the results from the original TensorFlow/TPU-based paper.