research
∙
08/26/2023
Vision-Based Human Pose Estimation via Deep Learning: A Survey
Human pose estimation (HPE) has attracted a significant amount of attent...
share
research
∙
08/24/2023
WavMark: Watermarking for Audio Generation
Recent breakthroughs in zero-shot voice synthesis have enabled imitating...
research
∙
07/31/2023
UDAMA: Unsupervised Domain Adaptation through Multi-discriminator Adversarial Training with Noisy Labels Improves Cardio-fitness Prediction
Deep learning models have shown great promise in various healthcare moni...
research
∙
06/28/2023
Accelerating Transducers through Adjacent Token Merging
Recent end-to-end automatic speech recognition (ASR) systems often utili...
research
∙
06/28/2023
Prompting Large Language Models for Zero-Shot Domain Adaptation in Speech Recognition
The integration of Language Models (LMs) has proven to be an effective w...
research
∙
06/14/2023
Diffusion in Diffusion: Cyclic One-Way Diffusion for Text-Vision-Conditioned Generation
Text-to-Image (T2I) generation with diffusion models allows users to con...
research
∙
06/01/2023
Revisit Weakly-Supervised Audio-Visual Video Parsing from the Language Perspective
We focus on the weakly-supervised audio-visual video parsing task (AVVP)...
research
∙
05/31/2023
Accurate and Structured Pruning for Efficient Automatic Speech Recognition
Automatic Speech Recognition (ASR) has seen remarkable advancements with...
research
∙
04/28/2023
Click-Feedback Retrieval
Retrieving target information based on input query is of fundamental imp...
research
∙
03/23/2023
Visually-Prompted Language Model for Fine-Grained Scene Graph Generation in an Open World
Scene Graph Generation (SGG) aims to extract <subject, predicate, object...
research
∙
02/16/2023
Boundary Guided Mixing Trajectory for Semantic Control with Diffusion Models
Applying powerful generative denoising diffusion models (DDMs) for downs...
research
∙
01/05/2023
Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers
We introduce a language modeling approach for text to speech synthesis (...
research
∙
12/31/2022
Generative Graph Neural Networks for Link Prediction
Inferring missing links or detecting spurious ones based on observed gra...
research
∙
12/18/2022
BEATs: Audio Pre-Training with Acoustic Tokenizers
The massive growth of self-supervised learning (SSL) has been witnessed ...
research
∙
12/07/2022
Artificial Intelligence Security Competition (AISC)
The security of artificial intelligence (AI) is an important research ar...
research
∙
11/20/2022
Turning Silver into Gold: Domain Adaptation with Noisy Labels for Wearable Cardio-Respiratory Fitness Prediction
Deep learning models have shown great promise in various healthcare appl...
research
∙
11/18/2022
Exploring WavLM on Speech Enhancement
There is a surge in interest in self-supervised learning approaches for ...
research
∙
11/17/2022
LongFNT: Long-form Speech Recognition with Factorized Neural Transducer
Traditional automatic speech recognition (ASR) systems usually focus on ...
research
∙
11/09/2022
Speech separation with large-scale self-supervised learning
Self-supervised learning (SSL) methods such as WavLM have shown promisin...
research
∙
11/05/2022
LAMASSU: Streaming Language-Agnostic Multilingual Speech Recognition and Translation Using Neural Transducers
End-to-end formulation of automatic speech recognition (ASR) and speech ...
research
∙
11/02/2022
Two-Stream Network for Sign Language Recognition and Translation
Sign languages are visual languages using manual articulations and non-m...
research
∙
10/24/2022
Real-time Speech Interruption Analysis: From Cloud to Client Deployment
Meetings are an essential form of communication for all types of organiz...
research
∙
10/16/2022
STAR: Zero-Shot Chinese Character Recognition with Stroke- and Radical-Level Decompositions
Zero-shot Chinese character recognition has attracted rising attention i...
research
∙
10/12/2022
Foundation Transformers
A big convergence of model architectures across language, vision, speech...
research
∙
10/05/2022
Vision+X: A Survey on Multimodal Learning in the Light of Data
We are perceiving and communicating with the world in a multisensory man...
research
∙
09/30/2022
SpeechLM: Enhanced Speech Pre-Training with Unpaired Textual Data
How to boost speech pre-training with textual data is an unsolved proble...
research
∙
09/22/2022
The Microsoft System for VoxCeleb Speaker Recognition Challenge 2022
In this report, we describe our submitted system for track 2 of the VoxC...
research
∙
07/27/2022
SiRi: A Simple Selective Retraining Mechanism for Transformer-based Visual Grounding
In this paper, we investigate how to achieve better visual grounding wit...
research
∙
06/29/2022
Provably Efficient Reinforcement Learning for Online Adaptive Influence Maximization
Online influence maximization aims to maximize the influence spread of a...
research
∙
06/15/2022
Discrete Contrastive Diffusion for Cross-Modal and Conditional Generation
Diffusion probabilistic models (DPMs) have become a popular approach to ...
research
∙
04/27/2022
Ultra Fast Speech Separation Model with Teacher Student Learning
Transformer has been successfully applied to speech separation recently ...
research
∙
04/27/2022
Why does Self-Supervised Learning for Speech Recognition Benefit Speaker Recognition?
Recently, self-supervised learning (SSL) has demonstrated strong perform...
research
∙
04/14/2022
A collaborative decomposition-based evolutionary algorithm integrating normal and penalty-based boundary intersection for many-objective optimization
Decomposition-based evolutionary algorithms have become fairly popular f...
research
∙
04/07/2022
Speech Pre-training with Acoustic Piece
Previous speech pre-training methods, such as wav2vec2.0 and HuBERT, pre...
research
∙
04/01/2022
Quantized GAN for Complex Music Generation from Dance Videos
We present Dance2Music-GAN (D2M-GAN), a novel adversarial multi-modal fr...
research
∙
03/30/2022
Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddings
This paper presents a streaming speaker-attributed automatic speech reco...
research
∙
02/02/2022
Streaming Multi-Talker ASR with Token-Level Serialized Output Training
This paper proposes a token-level serialized output training (t-SOT), a ...
research
∙
01/10/2022
Multi-query Video Retrieval
Retrieving target videos based on text descriptions is a task of great p...
research
∙
12/16/2021
Self-Supervised Learning for speech recognition with Intermediate layer supervision
Recently, pioneer work finds that speech pre-trained models can solve fu...
research
∙
10/26/2021
WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing
Self-supervised learning (SSL) achieves great success in speech recognit...
research
∙
10/12/2021
Large-scale Self-Supervised Speech Representation Learning for Automatic Speaker Verification
The speech representations learned from large-scale unlabeled data have ...
research
∙
10/12/2021
UniSpeech-SAT: Universal Speech Representation Learning with Speaker Aware Pre-Training
Self-supervised learning (SSL) is a long-standing goal for speech proces...
research
∙
10/06/2021
Internal Language Model Adaptation with Text-Only Data for End-to-End Speech Recognition
Text-only adaptation of an end-to-end (E2E) model remains a challenging ...
research
∙
09/29/2021
Contrastive Video-Language Segmentation
We focus on the problem of segmenting a certain object referred by a nat...
research
∙
09/12/2021
Knowledge Enhanced Fine-Tuning for Better Handling Unseen Entities in Dialogue Generation
Although pre-training models have achieved great success in dialogue gen...
research
∙
09/03/2021
Detecting Speaker Personas from Conversational Texts
Personas are useful for dialogue response prediction. However, the perso...
research
∙
08/22/2021
Flexible Clustered Federated Learning for Client-Level Data Distribution Shift
Federated Learning (FL) enables the multiple participating devices to co...
research
∙
07/05/2021
Investigation of Practical Aspects of Single Channel Speech Separation for ASR
Speech separation has been successfully applied as a frontend processing...
research
∙
06/26/2021
Saying the Unseen: Video Descriptions via Dialog Agents
Current vision and language tasks usually take complete visual data (e.g...
research
∙
06/04/2021