research
∙
08/15/2023
A^2Nav: Action-Aware Zero-Shot Robot Navigation by Exploiting Vision-and-Language Ability of Foundation Models
We study the task of zero-shot vision-and-language navigation (ZS-VLN), ...
share
research
∙
07/24/2023
3D-LLM: Injecting the 3D World into Large Language Models
Large language models (LLMs) and Vision-Language Models (VLMs) have been...
research
∙
07/22/2023
Learning Vision-and-Language Navigation from YouTube Videos
Vision-and-language navigation (VLN) requires an embodied agent to navig...
research
∙
07/20/2023
Vesper: A Compact and Effective Pretrained Model for Speech Emotion Recognition
This paper presents a paradigm that adapts general large-scale pretraine...
research
∙
03/21/2023
Detecting the open-world objects with the help of the Brain
Open World Object Detection (OWOD) is a novel computer vision task with ...
research
∙
10/14/2022
Weakly-Supervised Multi-Granularity Map Learning for Vision-and-Language Navigation
We address a practical yet challenging problem of training robot agents ...
research
∙
10/14/2022
Learning Active Camera for Multi-Object Navigation
Getting robots to navigate to multiple objects autonomously is essential...
research
∙
10/12/2022
M^3Video: Masked Motion Modeling for Self-Supervised Video Representation Learning
We study self-supervised video representation learning that seeks to lea...
research
∙
08/07/2020
Location-aware Graph Convolutional Networks for Video Question Answering
We addressed the challenging task of video question answering, which req...
research
∙
07/21/2020
Foley Music: Learning to Generate Music from Videos
In this paper, we introduce Foley Music, a system that can synthesize pl...
research
∙
07/14/2020
Generating Visually Aligned Sound from Videos
We focus on the task of generating sound from natural videos, and the so...
research
∙
04/07/2020
Dense Regression Network for Video Grounding
We address the problem of video grounding from natural language queries....
research
∙
10/25/2019