research
∙
08/11/2023
BOLAA: Benchmarking and Orchestrating LLM-augmented Autonomous Agents
The massive successes of large language models (LLMs) encourage the emer...
share
research
∙
08/04/2023
Retroformer: Retrospective Large Language Agents with Policy Gradient Optimization
Recent months have seen the emergence of a powerful new trend in which l...
research
∙
07/18/2023
REX: Rapid Exploration and eXploitation for AI Agents
In this paper, we propose an enhanced approach for Rapid Exploration and...
research
∙
05/18/2023
UniControl: A Unified Diffusion Model for Controllable Visual Generation In the Wild
Achieving machine autonomy and human control often represent divergent o...
research
∙
03/31/2023
Procedure-Aware Pretraining for Instructional Video Understanding
Our goal is to learn a video representation that is useful for downstrea...
research
∙
03/29/2023
Mask-free OVIS: Open-Vocabulary Instance Segmentation without Manual Mask Annotations
Existing instance segmentation models learn task-specific information us...
research
∙
03/10/2023
On the Unlikelihood of D-Separation
Causal discovery aims to recover a causal graph from data generated by i...
research
∙
03/09/2023
Deformer: Dynamic Fusion Transformer for Robust Hand Pose Estimation
Accurately estimating 3D hand pose is crucial for understanding how huma...
research
∙
01/06/2023
Model-Agnostic Hierarchical Attention for 3D Object Detection
Transformers as versatile network architectures have recently seen great...
research
∙
05/02/2022
The AI Index 2022 Annual Report
Welcome to the fifth edition of the AI Index Report! The latest edition ...
research
∙
12/17/2021
Align and Prompt: Video-and-Language Pre-training with Entity Prompts
Video-and-language pre-training has shown promising improvements on vari...
research
∙
12/01/2021
PreViTS: Contrastive Pretraining with Video Tracking Supervision
Videos are a rich source for self-supervised learning (SSL) of visual re...
research
∙
11/18/2021
Towards Open Vocabulary Object Detection without Human-provided Bounding Boxes
Despite great progress in object detection, most existing methods are li...
research
∙
06/21/2021
TNT: Text-Conditioned Network with Transductive Inference for Few-Shot Video Classification
Recently, few-shot learning has received increasing interest. Existing e...
research
∙
03/09/2021
The AI Index 2021 Annual Report
Welcome to the fourth edition of the AI Index Report. This year we signi...
research
∙
12/15/2019
Action Genome: Actions as Composition of Spatio-temporal Scene Graphs
Action recognition has typically treated actions and activities as monol...
research
∙
11/13/2019
Motion Reasoning for Goal-Based Imitation Learning
We address goal-based imitation learning, where the aim is to output the...
research
∙
11/04/2019
Disentangling Human Dynamics for Pedestrian Locomotion Forecasting with Noisy Supervision
We tackle the problem of Human Locomotion Forecasting, a task for jointl...
research
∙
10/08/2019
Bias-Resilient Neural Network
Presence of bias and confounding effects is inarguably one of the most c...
research
∙
10/03/2019
Learning Temporal Action Proposals With Fewer Labels
Temporal action proposals are a common module in action detection pipeli...
research
∙
09/08/2019
Imitation Learning for Human Pose Prediction
Modeling and prediction of human motion dynamics has long been a challen...
research
∙
08/16/2019
Continuous Relaxation of Symbolic Planner for One-Shot Imitation Learning
We address one-shot imitation learning, where the goal is to execute a p...
research
∙
07/02/2019
Procedure Planning in Instructional Videos
We propose a new challenging task: procedure planning in instructional v...
research
∙
06/27/2019
Few-Shot Video Classification via Temporal Alignment
There is a growing interest in learning a model which could recognize no...
research
∙
04/24/2019
Segmenting the Future
Predicting the future is an important aspect for decision-making in robo...
research
∙
02/11/2019
Peeking into the Future: Predicting Future Person Activities and Locations in Videos
Deciphering human behaviors to predict their future paths/trajectories a...
research
∙
01/09/2019
D^3TW: Discriminative Differentiable Dynamic Time Warping for Weakly Supervised Action Alignment and Segmentation
We address weakly-supervised action alignment and segmentation in videos...
research
∙
10/23/2018
Action-Agnostic Human Pose Forecasting
Predicting and forecasting human dynamics is a very interesting but chal...
research
∙
09/24/2018
Translating Navigation Instructions in Natural Language to a High-Level Plan for Behavioral Robot Navigation
We propose an end-to-end deep learning model for translating free-form n...
research
∙
08/11/2018
The ActivityNet Large-Scale Activity Recognition Challenge 2018 Summary
The 3rd annual installment of the ActivityNet Large- Scale Activity Reco...
research
∙
08/06/2018
Liquid Pouring Monitoring via Rich Sensory Inputs
Humans have the amazing ability to perform very subtle manipulation task...
research
∙
08/01/2018
Interpretable Visual Question Answering by Visual Grounding from Attention Supervision Mining
A key aspect of VQA models that are interpretable is their ability to gr...
research
∙
07/10/2018
Neural Task Graphs: Generalizing to Unseen Tasks from a Single Video Demonstration
Our goal is for a robot to execute a previously unseen task based on a s...
research
∙
06/11/2018
Learning to Decompose and Disentangle Representations for Video Prediction
Our goal is to predict future video frames given a sequence of input fra...
research
∙
03/12/2018
A Deep Learning Based Behavioral Approach to Indoor Autonomous Navigation
We present a semantically rich graph representation for indoor robotic n...
research
∙
11/30/2017
Graph Distillation for Action Detection with Privileged Information
In this work, we propose a technique that tackles the video understandin...
research
∙
10/22/2017
ActivityNet Challenge 2017 Summary
The ActivityNet Large Scale Activity Recognition Challenge 2017 Summary:...
research
∙
05/18/2017
Agent-Centric Risk Assessment: Accident Anticipation and Risky Region Localization
For survival, a living agent must have the ability to assess risk (1) by...
research
∙
05/02/2017
Dense-Captioning Events in Videos
Most natural videos contain numerous events. For example, in a video of ...
research
∙
03/07/2017
Unsupervised Visual-Linguistic Reference Resolution in Instructional Videos
We propose an unsupervised method for reference resolution in instructio...
research
∙
11/12/2016
Leveraging Video Descriptions to Learn Video Question Answering
We propose a scalable approach to learn video-based question answering (...
research
∙
08/25/2016
Title Generation for User Generated Videos
A great video title describes the most salient event compactly and captu...
research
∙
07/28/2016
Connectionist Temporal Modeling for Weakly Supervised Action Labeling
We propose a weakly-supervised framework for action labeling in video, w...
research
∙
06/15/2016