research
∙
09/21/2022
Mega: Moving Average Equipped Gated Attention
The design choices in the Transformer attention mechanism, including wea...
share
research
∙
05/19/2022
Training Vision-Language Transformers from Captions Alone
We show that Vision-Language Transformers can be learned without human l...
research
∙
12/16/2021
