research
∙
09/17/2023
Continuous Modeling of the Denoising Process for Speech Enhancement Based on Deep Learning
In this paper, we explore a continuous modeling approach for deep-learni...
share
research
∙
09/17/2023
Neural Speaker Diarization Using Memory-Aware Multi-Speaker Embedding with Sequence-to-Sequence Architecture
We propose a novel neural speaker diarization system using memory-aware ...
research
∙
09/16/2023
Boosting End-to-End Multilingual Phoneme Recognition through Exploiting Universal Speech Attributes Constraints
We propose a first step toward multilingual end-to-end automatic speech ...
research
∙
09/15/2023
The Multimodal Information Based Speech Processing (MISP) 2023 Challenge: Audio-Visual Target Speaker Extraction
Previous Multimodal Information based Speech Processing (MISP) challenge...
research
∙
08/28/2023
The USTC-NERCSLIP Systems for the CHiME-7 DASR Challenge
This technical report details our submission system to the CHiME-7 DASR ...
research
∙
08/14/2023
Improving Audio-Visual Speech Recognition by Lip-Subword Correlation Based Visual Pre-training and Cross-Modal Fusion Encoder
In recent research, slight performance improvement is observed from auto...
research
∙
06/14/2023
Variance-Preserving-Based Interpolation Diffusion Models for Speech Enhancement
The goal of this study is to implement diffusion models for speech enhan...
research
∙
06/01/2023
A Multi-dimensional Deep Structured State Space Approach to Speech Enhancement Using Small-footprint Models
We propose a multi-dimensional structured state space (S4) approach to s...
research
∙
03/11/2023
The Multimodal Information based Speech Processing (MISP) 2022 Challenge: Audio-Visual Diarization and Recognition
The Multi-modal Information based Speech Processing (MISP) challenge aim...
research
∙
11/02/2022
A Quantum Kernel Learning Approach to Acoustic Modeling for Spoken Command Recognition
We propose a quantum kernel learning (QKL) framework to address the inhe...
research
∙
10/26/2022
Deep Learning Based Audio-Visual Multi-Speaker DOA Estimation Using Permutation-Free Loss Function
In this paper, we propose a deep learning based multi-speaker direction ...
research
∙
10/12/2022
An Ensemble Teacher-Student Learning Approach with Poisson Sub-sampling to Differential Privacy Preserving Speech Recognition
We propose an ensemble learning framework with Poisson sub-sampling to e...
research
∙
10/11/2022
An Experimental Study on Private Aggregation of Teacher Ensemble Learning for End-to-End Speech Recognition
Differential privacy (DP) is one data protection avenue to safeguard use...
research
∙
03/07/2022
A study on joint modeling and data augmentation of multi-modalities for audio-visual scene classification
In this paper, we propose two techniques, namely joint modeling and data...
research
∙
02/17/2022
A Study of Designing Compact Audio-Visual Wake Word Spotting System Based on Iterative Fine-Tuning in Neural Network Pruning
Audio-only-based wake word spotting (WWS) is challenging under noisy con...
research
∙
02/10/2022
The USTC-Ximalaya system for the ICASSP 2022 multi-channel multi-party meeting transcription (M2MeT) challenge
We propose two improvements to target-speaker voice activity detection (...
research
∙
11/17/2021
Information Fusion in Attention Networks Using Adaptive and Multi-level Factorized Bilinear Pooling for Audio-visual Emotion Recognition
Multimodal emotion recognition is a challenging task in emotion computin...
research
∙
10/16/2021
A Variational Bayesian Approach to Learning Latent Variables for Acoustic Knowledge Transfer
We propose a variational Bayesian (VB) approach to learning distribution...
research
∙
07/06/2021
Separation Guided Speaker Diarization in Realistic Mismatched Conditions
We propose a separation guided speaker diarization (SGSD) approach by fu...
research
∙
07/03/2021
A Lottery Ticket Hypothesis Framework for Low-Complexity Device-Robust Neural Acoustic Scene Classification
We propose a novel neural model compression strategy combining data augm...
research
∙
04/02/2021
PATE-AAE: Incorporating Adversarial Autoencoder into Private Aggregation of Teacher Ensembles for Spoken Command Classification
We propose using an adversarial autoencoder (AAE) to replace generative ...
research
∙
03/19/2021
USTC-NELSLIP System Description for DIHARD-III Challenge
This system description describes our submission system to the Third DIH...
research
∙
01/08/2021
A Four-Stage Data Augmentation Approach to ResNet-Conformer Based Acoustic Modeling for Sound Event Localization and Detection
In this paper, we propose a novel four-stage data augmentation approach ...
research
∙
12/28/2020
Lip-reading with Hierarchical Pyramidal Convolution and Self-Attention
In this paper, we propose a novel deep learning architecture to improvin...
research
∙
11/03/2020
A Two-Stage Approach to Device-Robust Acoustic Scene Classification
To improve device robustness, a highly desirable key feature of a compet...
research
∙
10/26/2020
Decentralizing Feature Extraction with Quantum Convolutional Neural Network for Automatic Speech Recognition
We propose a novel decentralized feature extraction approach in federate...
research
∙
09/21/2020
Correlating Subword Articulation with Lip Shapes for Embedding Aware Audio-Visual Speech Enhancement
In this paper, we propose a visual embedding approach to improving embed...
research
∙
08/12/2020
On Mean Absolute Error for Deep Neural Network Based Vector-to-Vector Regression
In this paper, we exploit the properties of mean absolute error (MAE) as...
research
∙
08/04/2020
Analyzing Upper Bounds on Mean Absolute Errors for Deep Neural Network Based Vector-to-Vector Regression
In this paper, we show that, in vector-to-vector regression utilizing de...
research
∙
07/31/2020
Relational Teacher Student Learning with Neural Label Embedding for Device Adaptation in Acoustic Scene Classification
In this paper, we propose a domain adaptation framework to address the d...
research
∙
07/31/2020
An Acoustic Segment Model Based Segment Unit Selection Approach to Acoustic Scene Classification with Partial Utterances
In this paper, we propose a sub-utterance unit selection framework to re...
research
∙
07/25/2020
Exploring Deep Hybrid Tensor-to-Vector Network Architectures for Regression Based Speech Enhancement
This paper investigates different trade-offs between the number of model...
research
∙
07/16/2020
Device-Robust Acoustic Scene Classification Based on Two-Stage Categorization and Data Augmentation
In this technical report, we present a joint effort of four groups, name...
research
∙
04/25/2020
L-Vector: Neural Label Embedding for Domain Adaptation
We propose a novel neural label embedding (NLE) scheme for the domain ad...
research
∙
03/31/2020
Characterizing Speech Adversarial Examples Using Self-Attention U-Net Enhancement
Recent studies have highlighted adversarial examples as ubiquitous threa...
research
∙
02/20/2020
Enhanced Adversarial Strategically-Timed Attacks against Deep Reinforcement Learning
Recent deep neural networks based techniques, especially those equipped ...
research
∙
02/03/2020
Tensor-to-Vector Regression for Multi-channel Speech Enhancement based on Tensor-Train Network
We propose a tensor-to-vector regression approach to multi-channel speec...
research
∙
11/28/2018
Acoustics-guided evaluation (AGE): a new measure for estimating performance of speech enhancement algorithms for robust ASR
One challenging problem of robust automatic speech recognition (ASR) is ...
research
∙
05/28/2018
Standard Cell Library Evaluation with Multiple lithography-compliant verification and Improved Synopsys Pin Access Checking Utility
While standard cell layouts are drawn with minimum design rules to maxim...
research
∙
05/28/2018
Multiple-Lithography-Compliant Verification for Standard Cell Library Development Flow
Starting from 22-nm, a standard cell must be designed to be full lithogr...
research
∙
05/25/2018
Constraining the Synopsys Pin Access Checker Utility for Improved Standard Cells Library Verification Flow
While standard cell layouts are drawn with minimum design rules for maxi...
research
∙
05/02/2018
Convolutional-Recurrent Neural Networks for Speech Enhancement
We propose an end-to-end model based on convolutional and recurrent neur...
research
∙
04/27/2015
A Probabilistic Framework for Representing Dialog Systems and Entropy-Based Dialog Management through Dynamic Stochastic State Evolution
In this paper, we present a probabilistic framework for goal-driven spok...
research
∙
03/06/2015