research
∙
08/24/2023
Code Llama: Open Foundation Models for Code
We release Code Llama, a family of large language models for code based ...
share
research
∙
08/10/2023
EXPRESSO: A Benchmark and Analysis of Discrete Expressive Speech Resynthesis
Recent work has shown that it is possible to resynthesize high-quality s...
research
∙
06/08/2023
Simple and Controllable Music Generation
We tackle the task of conditional music generation. We introduce MusicGe...
research
∙
05/22/2023
Textually Pretrained Speech Language Models
Speech language models (SpeechLMs) process and generate acoustic data on...
research
∙
12/22/2022
Pushing the performances of ASR models on English and Spanish accents
Speech to text models tend to be trained and evaluated against a single ...
research
∙
11/02/2022
Audio Language Modeling using Perceptually-Guided Discrete Representations
In this work, we study the task of Audio Language Modeling, in which we ...
research
∙
10/24/2022
High Fidelity Neural Audio Compression
We introduce a state-of-the-art real-time, high-fidelity, audio codec le...
research
∙
10/24/2022
Brouhaha: multi-task training for voice activity detection, speech-to-noise ratio, and C50 room acoustics estimation
Most automatic speech processing systems are sensitive to the acoustic e...
research
∙
09/30/2022
On The Robustness of Self-Supervised Representations for Spoken Language Modeling
Self-supervised representations have been extensively studied for discri...
research
∙
03/30/2022
Generative Spoken Dialogue Language Modeling
We introduce dGSLM, the first "textless" model able to generate audio sa...
research
∙
02/15/2022
textless-lib: a Library for Textless Spoken Language Processing
Textless spoken language processing research aims to extend the applicab...
research
∙
11/14/2021
Textless Speech Emotion Conversion using Decomposed and Discrete Representations
Speech emotion conversion is the task of modifying the perceived emotion...
research
∙
10/16/2021
ASR4REAL: An extended benchmark for speech models
Popular ASR benchmarks such as Librispeech and Switchboard are limited i...
research
∙
09/07/2021
Text-Free Prosody-Aware Generative Spoken Language Modeling
Speech pre-training has primarily demonstrated efficacy on classificatio...
research
∙
04/01/2021
Speech Resynthesis from Discrete Disentangled Self-Supervised Representations
We propose using self-supervised discrete representations for the task o...
research
∙
02/01/2021