research
∙
09/13/2023
CARE: Large Precision Matrix Estimation for Compositional Data
High-dimensional compositional data are prevalent in many applications. ...
share
research
∙
09/11/2023
LeBenchmark 2.0: a Standardized, Replicable and Enhanced Framework for Self-supervised Representations of French Speech
Self-supervised learning (SSL) is at the origin of unprecedented improve...
research
∙
07/12/2023
Sumformer: A Linear-Complexity Alternative to Self-Attention for Speech Recognition
Modern speech recognition systems rely on self-attention. Unfortunately,...
research
∙
11/08/2022
Cross-Attention is all you need: Real-Time Streaming Transformers for Personalised Speech Enhancement
Personalised speech enhancement (PSE), which extracts only the speech of...
research
∙
03/11/2022
Transformer-based Streaming ASR with Cumulative Attention
In this paper, we propose an online attention mechanism, known as cumula...
research
∙
02/09/2021
Train your classifier first: Cascade Neural Networks Training from upper layers to lower layers
Although the lower layers of a deep neural network learn features which ...
research
∙
11/08/2020
On the Usefulness of Self-Attention for Automatic Speech Recognition with Transformers
Self-attention models such as Transformers, which can capture temporal r...
research
∙
11/08/2020
Stochastic Attention Head Removal: A Simple and Effective Method for Improving Automatic Speech Recognition with Transformers
Recently, Transformers have shown competitive automatic speech recogniti...
research
∙
05/28/2020