research
∙
08/21/2023
X-VoE: Measuring eXplanatory Violation of Expectation in Physical Events
Intuitive physics is pivotal for human understanding of the physical wor...
share
research
∙
07/31/2023
Part-level Scene Reconstruction Affords Robot Interaction
Existing methods for reconstructing interactive scenes primarily focus o...
research
∙
07/13/2023
Making the Most Out of the Limited Context Length: Predictive Power Varies with Clinical Note Type and Note Section
Recent advances in large language models have led to renewed interest in...
research
∙
06/25/2023
Sequential Manipulation Planning for Over-actuated UAMs
We investigate the sequential manipulation planning problem for unmanned...
research
∙
06/01/2023
MEWL: Few-shot multimodal word learning with referential uncertainty
Without explicit feedback, humans can rapidly learn the meaning of words...
research
∙
04/17/2023
STRAP: Structured Object Affordance Segmentation with Point Supervision
With significant annotation savings, point supervision has been proven e...
research
∙
01/15/2023
Diffusion-based Generation, Optimization, and Planning in 3D Scenes
We introduce SceneDiffuser, a conditional generative model for 3D scene ...
research
∙
01/14/2023
A Reconfigurable Data Glove for Reconstructing Physical and Virtual Grasps
In this work, we present a reconfigurable data glove design to capture d...
research
∙
12/01/2022
To think inside the box, or to think out of the box? Scientific discovery via the reciprocation of insights and concepts
If scientific discovery is one of the main driving forces of human progr...
research
∙
10/18/2022
HUMANISE: Language-conditioned Human Motion Generation in 3D Scenes
Learning to generate diverse scene-aware and goal-oriented human motions...
research
∙
10/05/2022
On the Learning Mechanisms in Physical Reasoning
Is dynamics prediction indispensable for physical reasoning? If so, what...
research
∙
07/10/2022
Sequential Manipulation Planning on Scene Graph
We devise a 3D scene graph representation, contact graph+ (cg+), for eff...
research
∙
06/18/2022
EST: Evaluating Scientific Thinking in Artificial Agents
Theoretical ideas and empirical research have shown us a seemingly surpr...
research
∙
01/12/2022
Object Gathering with a Tethered Robot Duo
We devise a cooperative planning framework to generate optimal trajector...
research
∙
11/28/2021
Emergent Graphical Conventions in a Visual Communication Game
Humans communicate with graphical sketches apart from symbolic languages...
research
∙
09/08/2021
YouRefIt: Embodied Reference Understanding with Language and Gesture
We study the understanding of embodied reference: One agent uses both la...
research
∙
09/01/2021
Spatio-temporal Self-Supervised Representation Learning for 3D Point Clouds
To date, various 3D scene understanding tasks still lack practical and g...
research
∙
08/05/2021
Communicative Learning with Natural Gestures for Embodied Navigation Agents with Human-in-the-Scene
Human-robot collaboration is an essential research topic in artificial i...
research
∙
08/03/2021
Consolidating Kinematic Models to Promote Coordinated Mobile Manipulations
We construct a Virtual Kinematic Chain (VKC) that readily consolidates t...
research
∙
06/03/2021
Individual vs. Joint Perception: a Pragmatic Model of Pointing as Communicative Smithian Helping
The simple gesture of pointing can greatly augment ones ability to compr...
research
∙
04/19/2021
Synthesizing Diverse and Physically Stable Grasps with Arbitrary Hand Structures by Differentiable Force Closure Estimation
Existing grasp synthesis methods are either analytical or data-driven. T...
research
∙
04/07/2021
Learning Triadic Belief Dynamics in Nonverbal Communication from Videos
Humans possess a unique social cognition capability; nonverbal communica...
research
∙
03/30/2021
Reconstructing Interactive 3D Scenes by Panoptic Mapping and CAD Model Alignments
In this paper, we rethink the problem of scene reconstruction from an em...
research
∙
03/26/2021
ACRE: Abstract Causal REasoning Beyond Covariation
Causal induction, i.e., identifying unobservable mechanisms that lead to...
research
∙
03/26/2021
Abstract Spatial-Temporal Reasoning via Probabilistic Abduction and Execution
Spatial-temporal reasoning is a challenging task in Artificial Intellige...
research
∙
01/07/2021
Incorporating Vision Bias into Click Models for Image-oriented Search Engine
Most typical click models assume that the probability of a document to b...
research
∙
07/31/2020
LEMMA: A Multi-view Dataset for Learning Multi-agent Multi-task Activities
Understanding and interpreting human actions is a long-standing challeng...
research
∙
07/24/2020
Human-Robot Interaction in a Shared Augmented Reality Workspace
We design and develop a new shared Augmented Reality (AR) workspace for ...
research
∙
04/25/2020
Joint Inference of States, Robot Knowledge, and Human (False-)Beliefs
Aiming to understand how human (false-)belief–a core socio-cognitive abi...
research
∙
04/25/2020
Congestion-aware Evacuation Routing using Augmented Reality Devices
We present a congestion-aware routing solution for indoor evacuation, wh...
research
∙
04/25/2020
Machine Number Sense: A Dataset of Visual Arithmetic Problems for Abstract and Relational Reasoning
As a comprehensive indicator of mathematical thinking and intelligence, ...
research
∙
04/20/2020
Dark, Beyond Deep: A Paradigm Shift to Cognitive AI with Humanlike Common Sense
Recent progress in deep learning is essentially based on a "big data for...
research
∙
03/02/2020
A Hybrid Lagrangian-Eulerian Method for Topology Optimization
We propose LETO, a new hybrid Lagrangian-Eulerian method for topology op...
research
∙
12/16/2019
PerspectiveNet: 3D Object Detection from a Single RGB Image via Perspective Points
Detecting 3D objects from a single RGB image is intrinsically ambiguous,...
research
∙
11/29/2019
Learning Perceptual Inference by Contrasting
"Thinking in pictures," [1] i.e., spatial-temporal reasoning, effortless...
research
∙
11/25/2019
Theory-based Causal Transfer: Integrating Instance-level Induction and Abstract-level Structure Learning
Learning transferable knowledge across similar but different settings is...
research
∙
09/04/2019
Holistic++ Scene Understanding: Single-view 3D Holistic Scene Parsing and Human Pose Estimation with Human-Object Interaction and Physical Commonsense
We propose a new 3D holistic++ scene understanding problem, which jointl...
research
∙
04/02/2019
VRGym: A Virtual Testbed for Physical and Interactive AI
We propose VRGym, a virtual reality testbed for realistic human-robot in...
research
∙
03/07/2019
RAVEN: A Dataset for Relational and Analogical Visual rEasoNing
Dramatic progress has been witnessed in basic vision tasks involving low...
research
∙
12/13/2018
MetaStyle: Three-Way Trade-Off Among Speed, Flexibility, and Quality in Neural Style Transfer
An unprecedented booming has been witnessed in the research area of arti...
research
∙
10/31/2018
Cooperative Holistic Scene Understanding: Unifying 3D Object, Layout, and Camera Pose Estimation
Holistic 3D indoor scene understanding refers to jointly recovering the ...
research
∙
08/25/2018
Human-centric Indoor Scene Synthesis Using Stochastic Grammar
We present a human-centric method to sample and synthesize 3D room layou...
research
∙
08/07/2018
Holistic 3D Scene Parsing and Reconstruction from a Single RGB Image
We propose a computational framework to jointly parse a single RGB image...
research
∙
04/01/2017