research
∙
07/27/2023
Self-Supervised Visual Acoustic Matching
Acoustic matching aims to re-synthesize an audio clip to sound as if it ...
share
research
∙
07/22/2023
Replay: Multi-modal Multi-view Acted Videos for Casual Holography
We introduce Replay, a collection of multi-view, multi-modal videos of h...
research
∙
06/08/2023
SMUG Planner: A Safe Multi-Goal Planner for Mobile Robots in Challenging Environments
Robotic exploration or monitoring missions require mobile robots to auto...
research
∙
01/20/2023
Novel-View Acoustic Synthesis
We introduce the novel-view acoustic synthesis (NVAS) task: given the si...
research
∙
06/16/2022
SoundSpaces 2.0: A Simulation Platform for Visual-Acoustic Learning
We introduce SoundSpaces 2.0, a platform for on-the-fly geometry-based a...
research
∙
06/08/2022
Few-Shot Audio-Visual Learning of Environment Acoustics
Room impulse response (RIR) functions capture how the surrounding physic...
research
∙
02/22/2022
Sound Adversarial Audio-Visual Navigation
Audio-visual navigation task requires an agent to find a sound source in...
research
∙
02/14/2022
Visual Acoustic Matching
We introduce the visual acoustic matching task, in which an audio clip i...
research
∙
06/14/2021
Learning Audio-Visual Dereverberation
Reverberation from audio reflecting off surfaces and objects in the envi...
research
∙
12/21/2020
Semantic Audio-Visual Navigation
Recent work on audio-visual navigation assumes a constantly-sounding tar...
research
∙
08/21/2020
Learning to Set Waypoints for Audio-Visual Navigation
In audio-visual navigation, an agent intelligently travels through a com...
research
∙
05/04/2020
VisualEchoes: Spatial Image Representation Learning through Echolocation
Several animal species (e.g., bats, dolphins, and whales) and even visua...
research
∙
12/24/2019
Audio-Visual Embodied Navigation
Moving around in the world is naturally a multisensory experience, but t...
research
∙
09/28/2019
Relational Graph Learning for Crowd Navigation
We present a relational graph learning approach for robotic crowd naviga...
research
∙
09/24/2018