research
∙
08/07/2023
Exploiting Generalization in Offline Reinforcement Learning via Unseen State Augmentations
Offline reinforcement learning (RL) methods strike a balance between exp...
share
research
∙
08/02/2023
LEMMA: Learning Language-Conditioned Multi-Robot Manipulation
Complex manipulation tasks often require robots with complementary capab...
research
∙
03/02/2023
Alexa Arena: A User-Centric Interactive Platform for Embodied AI
We introduce Alexa Arena, a user-centric simulation platform for Embodie...
research
∙
01/12/2023
Language-Informed Transfer Learning for Embodied Household Activities
For service robots to become general-purpose in everyday household envir...
research
∙
01/05/2023
GIVL: Improving Geographical Inclusivity of Vision-Language Models with Pre-Training Methods
A key goal for the advancement of AI is to develop technologies that ser...
research
∙
12/10/2022
OpenD: A Benchmark for Language-Driven Door and Drawer Opening
We introduce OPEND, a benchmark for learning how to use a hand to open c...
research
∙
11/25/2022
TPA-Net: Generate A Dataset for Text to Physics-based Animation
Recent breakthroughs in Vision-Language (V L) joint research have achi...
research
∙
11/09/2022
Towards Reasoning-Aware Explainable VQA
The domain of joint vision-language understanding, especially in the con...
research
∙
08/26/2022
CH-MARL: A Multimodal Benchmark for Cooperative, Heterogeneous Multi-Agent Reinforcement Learning
We propose a multimodal (vision-and-language) benchmark for cooperative ...
research
∙
04/22/2022
A Multi-level Alignment Training Scheme for Video-and-Language Grounding
To solve video-and-language grounding tasks, the key is for the network ...
research
∙
02/27/2022
DialFRED: Dialogue-Enabled Agents for Embodied Instruction Following
Language-guided Embodied AI benchmarks requiring an agent to navigate an...
research
∙
02/15/2022
Privacy Preserving Visual Question Answering
We introduce a novel privacy-preserving methodology for performing Visua...
research
∙
01/24/2022
Learning to Act with Affordance-Aware Multimodal Neural SLAM
Recent years have witnessed an emerging paradigm shift toward embodied a...
research
∙
01/21/2022
Learning Two-Step Hybrid Policy for Graph-Based Interpretable Reinforcement Learning
We present a two-step hybrid reinforcement learning (RL) policy that is ...
research
∙
12/17/2021
Best of Both Worlds: A Hybrid Approach for Multi-Hop Explanation with Declarative Facts
Language-enabled AI systems can answer complex, multi-hop questions to h...
research
∙
11/10/2021
LUMINOUS: Indoor Scene Generation for Embodied AI Challenges
Learning-based methods for training embodied agents typically require a ...
research
∙
08/10/2021
Embodied BERT: A Transformer Model for Embodied, Language-guided Visual Task Completion
Language-guided robots performing home and office tasks must navigate in...
research
∙
05/24/2021
Learning Better Visual Dialog Agents with Pretrained Visual-Linguistic Representation
GuessWhat?! is a two-player visual dialog guessing game where player A a...
research
∙
01/09/2021
Are We There Yet? Learning to Localize in Embodied Instruction Following
Embodied instruction following is a challenging problem requiring an age...
research
∙
12/02/2020
Interactive Teaching for Conversational AI
Current conversational AI systems aim to understand a set of pre-designe...
research
∙
11/21/2020