research
∙
06/30/2023
Stitched ViTs are Flexible Vision Backbones
Large pretrained plain vision Transformers (ViTs) have been the workhors...
share
research
∙
02/13/2023
Stitchable Neural Networks
The public model zoo containing enormous powerful pretrained model famil...
research
∙
02/02/2023
A Survey on Efficient Training of Transformers
Recent advances in Transformers have come with a huge requirement on com...
research
∙
09/19/2022
EcoFormer: Energy-Saving Attention with Linear Complexity
Transformer is a transformative framework that models sequential data an...
research
∙
07/21/2022
An Efficient Spatio-Temporal Pyramid Transformer for Action Detection
The task of action detection aims at deducing both the action category a...
research
∙
05/26/2022
Fast Vision Transformers with HiLo Attention
Vision Transformers (ViTs) have triggered the most recent and significan...
research
∙
11/22/2021
Mesa: A Memory-saving Training Framework for Transformers
There has been an explosion of interest in designing high-performance Tr...
research
∙
05/29/2021
Less is More: Pay Less Attention in Vision Transformers
Transformers have become one of the dominant architectures in deep learn...
research
∙
03/19/2021
Scalable Visual Transformers with Hierarchical Pooling
The recently proposed Visual image Transformers (ViT) with pure attentio...
research
∙
07/29/2020