FROMAGe is a research implementation featuring a language model with visual grounding capabilities. The model uses linear projection layers and special [RET] tokens to bridge frozen pretrained LLMs with image embeddings, enabling image retrieval and multimodal dialogue. Precomputed visual embeddings on Conceptual Captions images support efficient retrieval-augmented generation. Model checkpoints are small (around 11MB) and included in the repository.