research
∙
06/14/2023
Language to Rewards for Robotic Skill Synthesis
Large language models (LLMs) have demonstrated exciting progress in acqu...
share
research
∙
05/24/2023
Barkour: Benchmarking Animal-level Agility with Quadruped Robots
Animals have evolved various agile locomotion strategies, such as sprint...
research
∙
05/19/2023
Multimodal Web Navigation with Instruction-Finetuned Foundation Models
The progress of autonomous web navigation has been hindered by the depen...
research
∙
05/05/2023
Deep RL at Scale: Sorting Waste in Office Buildings with a Fleet of Mobile Manipulators
We describe a system for deep reinforcement learning of robotic manipula...
research
∙
03/02/2023
Open-World Object Manipulation using Pre-trained Vision-Language Models
For robots to follow instructions from people, they must be able to conn...
research
∙
12/13/2022
RT-1: Robotics Transformer for Real-World Control at Scale
By transferring knowledge from large, diverse, task-agnostic datasets, m...
research
∙
10/15/2022
PI-QT-Opt: Predictive Information Improves Multi-Task Robotic Reinforcement Learning at Scale
The predictive information, the mutual information between the past and ...
research
∙
07/27/2022
PI-ARS: Accelerating Evolution-Learned Visual-Locomotion with Predictive Information Representations
Evolution Strategy (ES) algorithms have shown promising results in train...
research
∙
06/08/2022
Deep Hierarchical Planning from Pixels
Intelligent agents need to select long sequences of actions to solve com...
research
∙
05/30/2022
Multi-Game Decision Transformers
A longstanding goal of the field of AI is a strategy for compiling diver...
research
∙
05/16/2022
An Empirical Investigation of Representation Learning for Imitation
Imitation learning often needs a large demonstration set in order to han...
research
∙
04/04/2022
Do As I Can, Not As I Say: Grounding Language in Robotic Affordances
Large language models can encode a wealth of semantic knowledge about th...
research
∙
09/27/2021
Compressive Visual Representations
Learning effective visual representations that generalize well without h...
research
∙
07/24/2020
Predictive Information Accelerates Learning in RL
The Predictive Information is the mutual information between the past an...
research
∙
09/22/2019
Learning Visual Relation Priors for Image-Text Matching and Image Captioning with Neural Scene Graph Generators
Grounding language to visual relations is critical to various language-a...
research
∙
03/21/2018
Stacked Cross Attention for Image-Text Matching
In this paper, we study the problem of image-text matching. Inferring th...
research
∙
11/20/2017