research
∙
05/23/2022
Decoder Denoising Pretraining for Semantic Segmentation
Semantic segmentation labels are expensive and time consuming to acquire...
share
research
∙
04/18/2021
Simple and Efficient ways to Improve REALM
Dense retrieval has been shown to be effective for retrieving relevant d...
research
∙
03/23/2021
Scaling Local Self-Attention For Parameter Efficient Visual Backbones
Self-attention has the promise of improving computer vision systems due ...
research
∙
01/27/2021
Bottleneck Transformers for Visual Recognition
We present BoTNet, a conceptually simple yet powerful backbone architect...
research
∙
05/16/2020
Conformer: Convolution-augmented Transformer for Speech Recognition
Recently Transformer and Convolution neural network (CNN) based models h...
research
∙
09/06/2019
High Resolution Medical Image Analysis with Spatial Partitioning
Medical images such as 3D computerized tomography (CT) scans and patholo...
research
∙
06/13/2019
Stand-Alone Self-Attention in Vision Models
Convolutions are a fundamental building block of modern computer vision ...
research
∙
04/10/2019
Corpora Generation for Grammatical Error Correction
Grammatical Error Correction (GEC) has been recently modeled using the s...
research
∙
11/05/2018
Mesh-TensorFlow: Deep Learning for Supercomputers
Batch-splitting (data-parallelism) is the dominant distributed Deep Neur...
research
∙
10/31/2018
Weakly Supervised Grammatical Error Correction using Iterative Decoding
We describe an approach to Grammatical Error Correction (GEC) that is ef...
research
∙
05/28/2018
Theory and Experiments on Vector Quantized Autoencoders
Deep neural networks with discrete latent variables offer the promise of...
research
∙
04/26/2018
The Best of Both Worlds: Combining Recent Advances in Neural Machine Translation
The past year has witnessed rapid advances in sequence-to-sequence (seq2...
research
∙
03/16/2018
Tensor2Tensor for Neural Machine Translation
Tensor2Tensor is a library for deep learning models that is well-suited ...
research
∙
02/15/2018
Image Transformer
Image generation has been successfully cast as an autoregressive sequenc...
research
∙
02/15/2018
Image Tranformer
Image generation has been successfully cast as an autoregressive sequenc...
research
∙
06/16/2017
One Model To Learn Them All
Deep learning yields great results across many fields, from speech recog...
research
∙
06/12/2017