research
∙
09/19/2023
Bridging Zero-shot Object Navigation and Foundation Models through Pixel-Guided Navigation Skill
Zero-shot object navigation is a challenging task for home-assistance ro...
share
research
∙
08/08/2023
3D-VisTA: Pre-trained Transformer for 3D Vision and Text Alignment
3D vision-language grounding (3D-VL) is an emerging field that aims to c...
research
∙
08/07/2023
Tiny LVLM-eHub: Early Multimodal Experiments with Bard
Recent advancements in Large Vision-Language Models (LVLMs) have demonst...
research
∙
06/15/2023
LVLM-eHub: A Comprehensive Evaluation Benchmark for Large Vision-Language Models
Large Vision-Language Models (LVLMs) have recently played a dominant rol...
research
∙
05/18/2023
Instruct2Act: Mapping Multi-modality Instructions to Robotic Actions with Large Language Model
Foundation models have made significant strides in various applications,...
research
∙
05/16/2023
SUG: Single-dataset Unified Generalization for 3D Point Cloud Classification
Although Domain Generalization (DG) problem has been fast-growing in the...
research
∙
04/09/2023
ARNOLD: A Benchmark for Language-Grounded Task Learning With Continuous States in Realistic 3D Scenes
Understanding the continuous states of objects is essential for task lea...
research
∙
03/03/2023
Prompt, Generate, then Cache: Cascade of Foundation Models makes Strong Few-shot Learners
Visual recognition in low-data regimes requires deep neural networks to ...
research
∙
01/15/2023
Diffusion-based Generation, Optimization, and Planning in 3D Scenes
We introduce SceneDiffuser, a conditional generative model for 3D scene ...
research
∙
12/20/2022
ADAS: A Simple Active-and-Adaptive Baseline for Cross-Domain 3D Semantic Segmentation
State-of-the-art 3D semantic segmentation models are trained on the off-...
research
∙
11/28/2022
Perceive, Ground, Reason, and Act: A Benchmark for General-purpose Visual Representation
Current computer vision models, unlike the human visual system, cannot y...
research
∙
10/18/2022
HUMANISE: Language-conditioned Human Motion Generation in 3D Scenes
Learning to generate diverse scene-aware and goal-oriented human motions...
research
∙
10/17/2022
Unsupervised Object-Centric Learning with Bi-Level Optimized Query Slot Attention
The ability to decompose complex natural scenes into meaningful object-c...
research
∙
10/14/2022
SQA3D: Situated Question Answering in 3D Scenes
We propose a new task to benchmark scene understanding of embodied agent...
research
∙
10/08/2022
EgoTaskQA: Understanding Human Tasks in Egocentric Videos
Understanding human tasks through video observations is an essential cap...
research
∙
05/12/2022
Infrared Invisible Clothing:Hiding from Infrared Detectors at Multiple Angles in Real World
Thermal infrared imaging is widely used in body temperature measurement,...
research
∙
03/07/2022
Adversarial Texture for Fooling Person Detectors in the Physical World
Nowadays, cameras equipped with AI systems can capture and analyze image...
research
∙
09/08/2021
YouRefIt: Embodied Reference Understanding with Language and Gesture
We study the understanding of embodied reference: One agent uses both la...
research
∙
09/01/2021
Spatio-temporal Self-Supervised Representation Learning for 3D Point Clouds
To date, various 3D scene understanding tasks still lack practical and g...
research
∙
05/10/2021
Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoning
Geometry problem solving has attracted much attention in the NLP communi...
research
∙
04/04/2021
Learning Neural Representation of Camera Pose with Matrix Representation of Pose Shift via View Synthesis
How to effectively represent camera pose is an essential problem in 3D c...
research
∙
03/24/2021
VLGrammar: Grounded Grammar Induction of Vision and Language
Cognitive grammar suggests that the acquisition of language grammar is g...
research
∙
12/27/2020
SMART: A Situation Model for Algebra Story Problems via Attributed Grammar
Solving algebra story problems remains a challenging task in artificial ...
research
∙
07/31/2020
LEMMA: A Multi-view Dataset for Learning Multi-agent Multi-task Activities
Understanding and interpreting human actions is a long-standing challeng...
research
∙
07/03/2020
A Competence-aware Curriculum for Visual Concepts Learning via Question Answering
Humans can progressively learn visual concepts from easy to hard questio...
research
∙
06/11/2020
Closed Loop Neural-Symbolic Learning via Integrating Neural Perception, Grammar Parsing, and Symbolic Reasoning
The goal of neural-symbolic computation is to integrate the connectionis...
research
∙
04/25/2020
Memory-efficient training with streaming dimensionality reduction
The movement of large quantities of data during the training of a Deep N...
research
∙
04/20/2020
Dark, Beyond Deep: A Paradigm Shift to Cognitive AI with Humanlike Common Sense
Recent progress in deep learning is essentially based on a "big data for...
research
∙
12/16/2019
PerspectiveNet: 3D Object Detection from a Single RGB Image via Perspective Points
Detecting 3D objects from a single RGB image is intrinsically ambiguous,...
research
∙
09/04/2019
Understanding Human Gaze Communication by Spatio-Temporal Graph Reasoning
This paper addresses a new problem of understanding human gaze communica...
research
∙
09/04/2019
Holistic++ Scene Understanding: Single-view 3D Holistic Scene Parsing and Human Pose Estimation with Human-Object Interaction and Physical Commonsense
We propose a new 3D holistic++ scene understanding problem, which jointl...
research
∙
03/05/2019
Streaming Batch Eigenupdates for Hardware Neuromorphic Networks
Neuromorphic networks based on nanodevices, such as metal oxide memristo...
research
∙
10/31/2018
Cooperative Holistic Scene Understanding: Unifying 3D Object, Layout, and Camera Pose Estimation
Holistic 3D indoor scene understanding refers to jointly recovering the ...
research
∙
08/25/2018
Human-centric Indoor Scene Synthesis Using Stochastic Grammar
We present a human-centric method to sample and synthesize 3D room layou...
research
∙
08/07/2018
Holistic 3D Scene Parsing and Reconstruction from a Single RGB Image
We propose a computational framework to jointly parse a single RGB image...
research
∙
08/02/2017
Predicting Human Activities Using Stochastic Grammar
This paper presents a novel method to predict future human activities fr...
research
∙
04/01/2017