research
∙
05/18/2023
Whisper-KDQ: A Lightweight Whisper via Guided Knowledge Distillation and Quantization for Efficient ASR
Due to the rapid development of computing hardware resources and the dra...
share
research
∙
04/13/2023
RSIR Transformer: Hierarchical Vision Transformer using Random Sampling Windows and Important Region Windows
Recently, Transformers have shown promising performance in various visio...
research
∙
11/17/2022
LongFNT: Long-form Speech Recognition with Factorized Neural Transducer
Traditional automatic speech recognition (ASR) systems usually focus on ...
research
∙
10/10/2022
BoundaryFace: A mining framework with noise label self-correction for Face Recognition
Face recognition has made tremendous progress in recent years due to the...
research
∙
09/30/2022
SpeechLM: Enhanced Speech Pre-Training with Unpaired Textual Data
How to boost speech pre-training with textual data is an unsolved proble...
research
∙
09/19/2022
Axially Expanded Windows for Local-Global Interaction in Vision Transformers
Recently, Transformers have shown promising performance in various visio...
research
∙
07/15/2022
Knowledge Transfer and Distillation from Autoregressive to Non-Autoregressive Speech Recognition
Modern non-autoregressive (NAR) speech recognition systems aim to accele...
research
∙
06/15/2022
Self-Supervised Implicit Attention: Guided Attention by The Model Itself
We propose Self-Supervised Implicit Attention (SSIA), a new approach tha...
research
∙
06/10/2022
Position Labels for Self-Supervised Vision Transformer
Position encoding is important for vision transformer (ViT) to capture t...
research
∙
04/21/2022
Layer-wise Fast Adaptation for End-to-End Multi-Accent Speech Recognition
Accent variability has posed a huge challenge to automatic speech recogn...
research
∙
03/30/2022
ReplaceBlock: An improved regularization method based on background information
Attention mechanism, being frequently used to train networks for better ...
research
∙
03/24/2022
The Fixed Sub-Center: A Better Way to Capture Data Complexity
Treating class with a single center may hardly capture data distribution...
research
∙
03/06/2018
A Hybrid Method for Traffic Flow Forecasting Using Multimodal Deep Learning
Traffic flow forecasting has been regarded as a key problem of intellige...
research
∙
11/22/2017