lucidrains/g-mlp-pytorch
PyTorch implementation of gMLP, an all-MLP architecture that replaces attention mechanisms in Transformers.
Not currently ranked — collecting fresh signals.
star history
This repository provides a PyTorch implementation of gMLP, a deep learning model architecture from a Google research paper that replaces attention mechanisms with spatial gating in MLPs. It includes classes for masked language modeling and vision classification tasks, supporting both standard gMLP and an attention-augmented variant (aMLP).
Frequently asked
- What is lucidrains/g-mlp-pytorch?
- PyTorch implementation of gMLP, an all-MLP architecture that replaces attention mechanisms in Transformers.
- Is g-mlp-pytorch open source?
- Yes — lucidrains/g-mlp-pytorch is open source, released under the MIT license.
- What language is g-mlp-pytorch written in?
- lucidrains/g-mlp-pytorch is primarily written in Python.
- How popular is g-mlp-pytorch?
- lucidrains/g-mlp-pytorch has 431 stars on GitHub.
- Where can I find g-mlp-pytorch?
- lucidrains/g-mlp-pytorch is on GitHub at https://github.com/lucidrains/g-mlp-pytorch.