This repository hosts the Nucleotide Transformer and related models, which are foundation models trained on genomic data using JAX and the Transformer architecture. It provides pre-trained weights and inference code for extracting insights from biological sequences, with applications spanning genomics and transcriptomics. The models have been trained on large-scale GPU/TPU infrastructure including Cambridge-1 and TPU-v4 accelerators.