research
∙
09/03/2023
NADiffuSE: Noise-aware Diffusion-based Model for Speech Enhancement
The goal of speech enhancement (SE) is to eliminate the background inter...
share
research
∙
08/25/2023
MultiCapCLIP: Auto-Encoding Prompts for Zero-Shot Multilingual Visual Captioning
Supervised visual captioning models typically require a large scale of i...
research
∙
07/28/2023
Improving Audio-Text Retrieval via Hierarchical Cross-Modal Interaction and Auxiliary Captions
Most existing audio-text retrieval (ATR) methods focus on constructing c...
research
∙
07/26/2023
G2L: Semantically Aligned and Uniform Video Grounding via Geodesic and Game Theory
The recent video grounding works attempt to introduce vanilla contrastiv...
research
∙
07/05/2023
Multimodal Prompt Learning for Product Title Generation with Extremely Limited Labels
Generating an informative and attractive title for the product is a cruc...
research
∙
05/04/2023
HiFi-Codec: Group-residual Vector quantization for High Fidelity Audio Codec
Audio codec models are widely used in audio communication as a crucial t...
research
∙
03/30/2023
WavCaps: A ChatGPT-Assisted Weakly-Labelled Audio Captioning Dataset for Audio-Language Multimodal Research
The advancement of audio-language (AL) multimodal learning tasks has bee...
research
∙
03/30/2023
TLAG: An Informative Trigger and Label-Aware Knowledge Guided Model for Dialogue-based Relation Extraction
Dialogue-based Relation Extraction (DRE) aims to predict the relation ty...
research
∙
03/28/2023
Unify, Align and Refine: Multi-Level Semantic Alignment for Radiology Report Generation
Automatic radiology report generation has attracted enormous research in...
research
∙
03/15/2023
PoseRAC: Pose Saliency Transformer for Repetitive Action Counting
This paper presents a significant contribution to the field of repetitiv...
research
∙
03/11/2023
ZeroNLG: Aligning and Autoencoding Domains for Zero-Shot Multimodal and Multilingual Natural Language Generation
Natural Language Generation (NLG) accepts input data in the form of imag...
research
∙
03/10/2023
Improving Text-Audio Retrieval by Text-aware Attention Pooling and Prior Matrix Revised Loss
In text-audio retrieval (TAR) tasks, due to the heterogeneity of content...
research
∙
03/10/2023
Improving Weakly Supervised Sound Event Detection with Causal Intervention
Existing weakly supervised sound event detection (WSSED) work has not ex...
research
∙
02/23/2023
FTM: A Frame-level Timeline Modeling Method for Temporal Graph Representation Learning
Learning representations for graph-structured data is essential for grap...
research
∙
02/18/2023
SSVMR: Saliency-based Self-training for Video-Music Retrieval
With the rise of short videos, the demand for selecting appropriate back...
research
∙
01/15/2023
Generating Templated Caption for Video Grounding
Video grounding aims to locate a moment of interest matching the given q...
research
∙
12/16/2022
Towards Unified All-Neural Beamforming for Time and Frequency Domain Speech Separation
Recently, frequency domain all-neural beamforming methods have achieved ...
research
∙
12/07/2022
M3ST: Mix at Three Levels for Speech Translation
How to solve the data scarcity problem for end-to-end speech-to-text tra...
research
∙
11/22/2022
Aligning Source Visual and Target Language Domains for Unpaired Video Captioning
Training supervised video captioning model requires coupled video-captio...
research
∙
11/08/2022
A Dynamic Graph Interactive Framework with Label-Semantic Injection for Spoken Language Understanding
Multi-intent detection and slot filling joint models are gaining increas...
research
∙
11/04/2022
NoreSpeech: Knowledge Distillation based Conditional Diffusion Model for Noise-robust Expressive TTS
Expressive text-to-speech (TTS) can synthesize a new speaking style by i...
research
∙
10/28/2022
DiMBERT: Learning Vision-Language Grounded Representations with Disentangled Multimodal-Attention
Vision-and-language (V-L) tasks require the system to understand both vi...
research
∙
10/19/2022
Prophet Attention: Predicting Attention with Future Attention for Improved Image Captioning
Recently, attention based models have been used extensively in many sequ...
research
∙
10/06/2022
Video Referring Expression Comprehension via Transformer with Content-aware Query
Video Referring Expression Comprehension (REC) aims to localize a target...
research
∙
07/21/2022
Correspondence Matters for Video Referring Expression Comprehension
We investigate the problem of video Referring Expression Comprehension (...
research
∙
07/21/2022
LocVTP: Video-Text Pre-training for Temporal Localization
Video-Text Pre-training (VTP) aims to learn transferable representations...
research
∙
07/20/2022
Diffsound: Discrete Diffusion Model for Text-to-sound Generation
Generating sound effects that humans want is an important topic. However...
research
∙
06/05/2022
LAE: Language-Aware Encoder for Monolingual and Multilingual ASR
Despite the rapid progress in automatic speech recognition (ASR) researc...
research
∙
05/03/2022
Improving Dual-Microphone Speech Enhancement by Learning Cross-Channel Features with Multi-Head Attention
Hand-crafted spatial features, such as inter-channel intensity differenc...
research
∙
04/15/2022
Speaker-Aware Mixture of Mixtures Training for Weakly Supervised Speaker Extraction
Dominant researches adopt supervised training for speaker extraction, wh...
research
∙
04/05/2022
RaDur: A Reference-aware and Duration-robust Network for Target Sound Detection
Target sound detection (TSD) aims to detect the target sound from a mixt...
research
∙
04/05/2022
A Two-student Learning Framework for Mixed Supervised Target Sound Detection
Target sound detection (TSD) aims to detect the target sound from mixtur...
research
∙
04/04/2022
Target Confusion in End-to-end Speaker Extraction: Analysis and Approaches
Recently, end-to-end speaker extraction has attracted increasing attenti...
research
∙
04/02/2022
Improving Target Sound Extraction with Timestamp Information
Target sound extraction (TSE) aims to extract the sound part of a target...
research
∙
03/31/2022
Learning Decoupling Features Through Orthogonality Regularization
Keyword spotting (KWS) and speaker verification (SV) are two important t...
research
∙
03/31/2022
SpatioTemporal Focus for Skeleton-based Action Recognition
Graph convolutional networks (GCNs) are widely adopted in skeleton-based...
research
∙
03/29/2022
Integrate Lattice-Free MMI into End-to-End Speech Recognition
In automatic speech recognition (ASR) research, discriminative criteria ...
research
∙
03/25/2022
Unsupervised Pre-training for Temporal Action Localization Tasks
Unsupervised video representation learning has made remarkable achieveme...
research
∙
01/06/2022
Improving Mandarin End-to-End Speech Recognition with Word N-gram Language Model
Despite the rapid progress of end-to-end (E2E) automatic speech recognit...
research
∙
12/19/2021
Detect what you want: Target Sound Detection
Human beings can perceive a target sound that we are interested in from ...
research
∙
12/05/2021
Consistent Training and Decoding For End-to-end Speech Recognition Using Lattice-free MMI
Recently, End-to-End (E2E) frameworks have achieved remarkable results o...
research
∙
11/30/2021
CLIP Meets Video Captioners: Attribute-Aware Representation Learning Promotes Accurate Captioning
For video captioning, "pre-training and fine-tuning" has become a de fac...
research
∙
10/12/2021
Improving the Performance of Automated Audio Captioning via Integrating the Acoustic and Semantic Information
Automated audio captioning (AAC) has developed rapidly in recent years, ...
research
∙
10/09/2021
A Mutual learning framework for Few-shot Sound Event Detection
Although prototypical network (ProtoNet) has proved to be an effective m...
research
∙
09/18/2021
Towards Joint Intent Detection and Slot Filling via Higher-order Attention
Intent detection (ID) and Slot filling (SF) are two major tasks in spoke...
research
∙
09/13/2021
On Pursuit of Designing Multi-modal Transformer for Video Grounding
Video grounding aims to localize the temporal segment corresponding to a...
research
∙
08/26/2021
HAN: Higher-order Attention Network for Spoken Language Understanding
Spoken Language Understanding (SLU), including intent detection and slot...
research
∙
08/25/2021
Fully Non-Homogeneous Atmospheric Scattering Modeling with Convolutional Neural Networks for Single Image Dehazing
In recent years, single image dehazing models (SIDM) based on atmospheri...
research
∙
08/18/2021
Joint Multiple Intent Detection and Slot Filling via Self-distillation
Intent detection and slot filling are two main tasks in natural language...
research
∙
08/12/2021