lucidrains/flamingo-pytorch
PyTorch implementation of DeepMind's Flamingo visual-language model with PerceiverResampler and GatedCrossAttentionBlock components.
Not currently ranked — collecting fresh signals.
star history
This repository provides a PyTorch implementation of the Flamingo model from DeepMind, a state-of-the-art few-shot visual question answering system. It includes the perceiver resampler for shrinking media sequences, specialized masked cross-attention blocks for allowing language models to attend to visual inputs, and tanh gating at the ends of cross-attention and feedforward blocks. The implementation enables building multimodal language models that can process interleaved text and images for few-shot learning.
Frequently asked
- What is lucidrains/flamingo-pytorch?
- PyTorch implementation of DeepMind's Flamingo visual-language model with PerceiverResampler and GatedCrossAttentionBlock components.
- Is flamingo-pytorch open source?
- Yes — lucidrains/flamingo-pytorch is open source, released under the MIT license.
- What language is flamingo-pytorch written in?
- lucidrains/flamingo-pytorch is primarily written in Python.
- How popular is flamingo-pytorch?
- lucidrains/flamingo-pytorch has 1.3k stars on GitHub.
- Where can I find flamingo-pytorch?
- lucidrains/flamingo-pytorch is on GitHub at https://github.com/lucidrains/flamingo-pytorch.