This repository implements the Transformer architecture (originally from NLP) applied to time series prediction. It adapts the model by replacing embeddings with linear layers, using modified positional encodings that better match day/night patterns, and applying windowed attention to focus on short-term patterns. The use case is modeling a numerical simulator for building energy consumption prediction.