research
∙
06/22/2023
AudioPaLM: A Large Language Model That Can Speak and Listen
We introduce AudioPaLM, a large language model for speech understanding ...
share
research
∙
03/31/2023
Practical Conformer: Optimizing size, speed and flops of Conformer for on-Device and cloud ASR
Conformer models maintain a large number of internal states, the vast ma...
research
∙
03/24/2023
VILA: Learning Image Aesthetics from User Comments with Vision-Language Pretraining
Assessing the aesthetics of an image is challenging, as it is influenced...
research
∙
03/23/2023
CoBIT: A Contrastive Bi-directional Image-Text Generation Model
The field of vision and language has witnessed a proliferation of pre-tr...
research
∙
02/08/2023
Noise2Music: Text-conditioned Music Generation with Diffusion Models
We introduce Noise2Music, where a series of diffusion models is trained ...
research
∙
10/10/2022
Deep object detection for waterbird monitoring using aerial imagery
Monitoring of colonial waterbird nesting islands is essential to trackin...
research
∙
09/02/2022
Normalization effects on deep neural networks
We study the effect of normalization on the layers of deep neural networ...
research
∙
06/22/2022
Scaling Autoregressive Models for Content-Rich Text-to-Image Generation
We present the Pathways Autoregressive Text-to-Image (Parti) model, whic...
research
∙
05/04/2022
CoCa: Contrastive Captioners are Image-Text Foundation Models
Exploring large-scale pretrained foundation models is of significant int...
research
∙
02/03/2022
Self-supervised Learning with Random-projection Quantizer for Speech Recognition
We present a simple and effective self-supervised learning approach for ...
research
∙
12/14/2021
Co-training Transformer with Videos and Images Improves Action Recognition
In learning action recognition, models are typically pre-trained on obje...
research
∙
10/09/2021
Vector-quantized Image Modeling with Improved VQGAN
Pretraining language models with next-token prediction on massive text c...
research
∙
09/27/2021
BigSSL: Exploring the Frontier of Large-Scale Semi-Supervised Learning for Automatic Speech Recognition
We summarize the results of a host of efforts using giant automatic spee...
research
∙
08/24/2021
SimVLM: Simple Visual Language Model Pretraining with Weak Supervision
With recent progress in joint modeling of visual and textual representat...
research
∙
11/21/2020
A Better and Faster End-to-End Model for Streaming ASR
End-to-end (E2E) models have shown to outperform state-of-the-art conven...
research
∙
11/20/2020
Normalization effects on shallow neural networks and related asymptotic expansions
We consider shallow (single hidden layer) neural networks and characteri...
research
∙
10/27/2020
Cascaded encoders for unifying streaming and non-streaming ASR
End-to-end (E2E) automatic speech recognition (ASR) models, by now, have...
research
∙
10/21/2020
FastEmit: Low-latency Streaming ASR with Sequence-level Emission Regularization
Streaming automatic speech recognition (ASR) aims to emit each hypothesi...
research
∙
10/12/2020
Universal ASR: Unify and Improve Streaming ASR with Full-context Modeling
Streaming automatic speech recognition (ASR) aims to emit each hypothesi...
research
∙
08/06/2020
Generative Adversarial Networks for Image and Video Synthesis: Algorithms and Applications
The generative adversarial network (GAN) framework has emerged as a powe...
research
∙
06/26/2020
Cross-Ssupervised Object Detection
After learning a new object category from image-level annotations (with ...
research
∙
06/26/2020
Cross-Supervised Object Detection
After learning a new object category from image-level annotations (with ...
research
∙
06/08/2020
Neural Sparse Representation for Image Restoration
Inspired by the robustness and efficiency of sparse representation in sp...
research
∙
05/16/2020
Dynamic Sparsity Neural Networks for Automatic Speech Recognition
In automatic speech recognition (ASR), model pruning is a widely adopted...
research
∙
05/16/2020
Conformer: Convolution-augmented Transformer for Speech Recognition
Recently Transformer and Convolution neural network (CNN) based models h...
research
∙
05/07/2020
ContextNet: Improving Convolutional Neural Networks for Automatic Speech Recognition with Global Context
Convolutional neural networks (CNN) have shown promising results for end...
research
∙
04/28/2020
Pyramid Attention Networks for Image Restoration
Self-similarity refers to the image prior widely used in image restorati...
research
∙
03/24/2020
BigNAS: Scaling Up Neural Architecture Search with Big Single-Stage Models
Neural architecture search (NAS) has shown promising results discovering...
research
∙
12/19/2019
Scale-wise Convolution for Image Restoration
While scale-invariant modeling has substantially boosted the performance...
research
∙
08/22/2019
Adversarial-Based Knowledge Distillation for Multi-Model Ensemble and Noisy Data Refinement
Generic Image recognition is a fundamental and fairly important visual p...
research
∙
03/27/2019
Network Slimming by Slimmable Networks: Towards One-Shot Architecture Search for Channel Numbers
We study how to set channel numbers in a neural network to achieve bette...
research
∙
03/12/2019
Universally Slimmable Networks and Improved Training Techniques
Slimmable networks are a family of neural networks that can instantly ad...
research
∙
01/10/2019
Smoothing Spline Semiparametric Density Models
Density estimation plays a fundamental role in many areas of statistics ...
research
∙
12/21/2018
Slimmable Neural Networks
We present a simple and general method to train a single neural network ...
research
∙
08/27/2018
Wide Activation for Efficient and Accurate Image Super-Resolution
In this report we demonstrate that with same parameters and computationa...
research
∙
06/18/2018
A Hierarchical Approach to Encrypted Data Packet Classification in Smart Home Gateways
With the pervasive network based services in smart homes, traditional ne...
research
∙
06/10/2018
Free-Form Image Inpainting with Gated Convolution
We present a novel deep learning based image inpainting system to comple...
research
∙
01/24/2018
Generative Image Inpainting with Contextual Attention
Recent deep learning based approaches have shown promising results on im...
research
∙
08/04/2016