Neural Monkey provides abstraction over TensorFlow for prototyping sequential neural network models in natural language processing. It offers standard building blocks including RNN encoders and decoders, multi-layer perceptrons, and supports GPU-accelerated training. The package includes training and serving utilities for tasks such as neural machine translation, image captioning, and sentence classification.