keplr-io/quiver
Quiver provides an interactive web dashboard for visualizing convolutional neural network layer activations from Keras models.

Quiver is a visualization toolkit for Keras models that allows developers to inspect and explore the activation patterns of individual layers in convolutional neural networks. It launches a local web server where users can load images and see how each layer responds to them across feature maps. The package includes both Python backend code for extracting layer outputs and a JavaScript frontend for interactive exploration of the network’s learned representations.