research
∙
08/17/2023
Bridging High-Quality Audio and Video via Language for Sound Effects Retrieval from Visual Queries
Finding the right sound effects (SFX) to match moments in a video is a d...
share
research
∙
06/15/2023
Language-Guided Music Recommendation for Video via Prompt Analogies
We propose a method to recommend music for an input video while allowing...
research
∙
06/02/2023
Efficient Spoken Language Recognition via Multilabel Classification
Spoken language recognition (SLR) is the task of automatically identifyi...
research
∙
04/17/2023
Conditional Generation of Audio from Video via Foley Analogies
The sound effects that designers add to videos are designed to convey a ...
research
∙
03/28/2023
Language-Guided Audio-Visual Source Separation via Trimodal Consistency
We propose a self-supervised approach for learning to perform audio sour...
research
∙
03/19/2023
Audio-Text Models Do Not Yet Leverage Natural Language
Multi-modal contrastive learning techniques in the audio-text domain hav...
research
∙
06/14/2022
It's Time for Artistic Correspondence in Music and Video
We present an approach for recommending a music track for a given video,...
research
∙
03/28/2022
Filler Word Detection and Classification: A Dataset and Benchmark
Filler words such as `uh' or `um' are sounds or words people use to sign...
research
∙
03/06/2022
HEAR 2021: Holistic Evaluation of Audio Representations
What audio embedding approach generalizes best to a wide range of downst...
research
∙
11/26/2021
Emotion Embedding Spaces for Matching Music to Stories
Content creators often use music to enhance their stories, as it can be ...
research
∙
10/18/2021
Who calls the shots? Rethinking Few-Shot Learning for Audio
Few-shot learning aims to train models that can recognize novel classes ...
research
∙
09/26/2021
Soundata: A Python library for reproducible use of audio datasets
Soundata is a Python library for loading and working with audio datasets...
research
∙
11/02/2020
What's All the FUSS About Free Universal Sound Separation Data?
We introduce the Free Universal Sound Separation (FUSS) dataset, a new c...
research
∙
11/02/2020
Sound Event Detection and Separation: a Benchmark on Desed Synthetic Soundscapes
We propose a benchmark of state-of-the-art sound event detection systems...
research
∙
09/11/2020
SONYC-UST-V2: An Urban Sound Tagging Dataset with Spatiotemporal Context
We present SONYC-UST-V2, a dataset for urban sound tagging with spatiote...
research
∙
08/09/2020
Metric Learning vs Classification for Disentangled Music Representation Learning
Deep representation learning offers a powerful paradigm for mapping inpu...
research
∙
08/09/2020
Disentangled Multidimensional Metric Learning for Music Similarity
Music similarity search is useful for a variety of creative tasks such a...
research
∙
08/07/2020
Controllable Neural Prosody Synthesis
Speech synthesis has recently seen significant improvements in fidelity,...
research
∙
08/06/2020
Few-Shot Drum Transcription in Polyphonic Music
Data-driven approaches to automatic drum transcription (ADT) are often l...
research
∙
07/08/2020
Improving Sound Event Detection In Domestic Environments Using Sound Separation
Performing sound event detection on real-world recordings often implies ...
research
∙
06/11/2020
Telling Left from Right: Learning Spatial Correspondence of Sight and Sound
Self-supervised audio-visual learning aims to capture useful representat...
research
∙
06/11/2020
Telling Left from Right: Learning Spatial Correspondence between Sight and Sound
Self-supervised audio-visual learning aims to capture useful representat...
research
∙
05/20/2019
Robust sound event detection in bioacoustic sensor networks
Bioacoustic sensors, sometimes known as autonomous recording units (ARUs...
research
∙
05/02/2018
SONYC: A System for the Monitoring, Analysis and Mitigation of Urban Noise Pollution
We present the Sounds of New York City (SONYC) project, a smart cities i...
research
∙
04/26/2018
Adaptive pooling operators for weakly labeled sound event detection
Sound event detection (SED) methods are tasked with labeling segments of...
research
∙
02/17/2018
CREPE: A Convolutional Representation for Pitch Estimation
The task of estimating the fundamental frequency of a monophonic sound r...
research
∙
08/15/2016