research
∙
07/10/2023
Learning Spatial Features from Audio-Visual Correspondence in Egocentric Videos
We propose a self-supervised method for learning representations based o...
share
research
∙
06/28/2023
SpotEM: Efficient Video Search for Episodic Memory
The goal in episodic memory (EM) is to search a long egocentric video to...
research
∙
01/18/2023
A Domain-Agnostic Approach for Characterization of Lifelong Learning Systems
Despite the advancement of machine learning techniques in recent years, ...
research
∙
01/02/2023
NaQ: Leveraging Narrations as Queries to Supervise Episodic Memory
Searching long egocentric videos with natural language queries (NLQ) has...
research
∙
06/08/2022
Few-Shot Audio-Visual Learning of Environment Acoustics
Room impulse response (RIR) functions capture how the surrounding physic...
research
∙
02/05/2022
Zero Experience Required: Plug Play Modular Transfer Learning for Semantic Visual Navigation
In reinforcement learning for visual navigation, it is common to develop...
research
∙
02/02/2022
Active Audio-Visual Separation of Dynamic Sound Sources
We explore active audio-visual separation for dynamic sound sources, whe...
research
∙
01/25/2022
PONI: Potential Functions for ObjectGoal Navigation with Interaction-free Learning
State-of-the-art approaches to ObjectGoal navigation rely on reinforceme...
research
∙
05/15/2021
Move2Hear: Active Audio-Visual Source Separation
We introduce the active audio-visual source separation problem, where an...
research
∙
02/03/2021
Environment Predictive Coding for Embodied Agents
We introduce environment predictive coding, a self-supervised approach t...
research
∙
12/21/2020
Semantic Audio-Visual Navigation
Recent work on audio-visual navigation assumes a constantly-sounding tar...
research
∙
11/17/2020
Modeling Fashion Influence from Photos
The evolution of clothing styles and their migration across the world is...
research
∙
08/21/2020
Learning to Set Waypoints for Audio-Visual Navigation
In audio-visual navigation, an agent intelligently travels through a com...
research
∙
08/21/2020
Occupancy Anticipation for Efficient Exploration and Navigation
State-of-the-art navigation methods leverage a spatial memory to general...
research
∙
05/04/2020
VisualEchoes: Spatial Image Representation Learning through Echolocation
Several animal species (e.g., bats, dolphins, and whales) and even visua...
research
∙
04/03/2020
From Paris to Berlin: Discovering Fashion Style Influences Around the World
The evolution of clothing styles and their migration across the world is...
research
∙
12/24/2019
Audio-Visual Embodied Navigation
Moving around in the world is naturally a multisensory experience, but t...
research
∙
07/14/2019
Smile, be Happy :) Emoji Embedding for Visual Sentiment Analysis
Due to the lack of large-scale datasets, the prevailing approach in visu...
research
∙
12/01/2018
Towards Traversing the Continuous Spectrum of Image Retrieval
Image retrieval is one of the most popular tasks in computer vision. How...
research
∙
10/30/2018
Informed Democracy: Voting-based Novelty Detection for Action Recognition
Novelty detection is crucial for real-life applications. While it is com...
research
∙
05/18/2017
Fashion Forward: Forecasting Visual Style in Fashion
What is the future of fashion? Tackling this question from a data-driven...
research
∙
11/22/2016
Relaxed Earth Mover's Distances for Chain- and Tree-connected Spaces and their use as a Loss Function in Deep Learning
The Earth Mover's Distance (EMD) computes the optimal cost of transformi...
research
∙
10/15/2016
Recovering the Missing Link: Predicting Class-Attribute Associations for Unsupervised Zero-Shot Learning
Collecting training images for all visual categories is not only expensi...
research
∙
04/01/2016