research
∙
07/24/2023
3D-LLM: Injecting the 3D World into Large Language Models
Large language models (LLMs) and Vision-Language Models (VLMs) have been...
share
research
∙
06/27/2023
Physion++: Evaluating Physical Scene Understanding that Requires Online Inference of Different Physical Properties
General physical scene understanding requires more than simply localizin...
research
∙
06/07/2023
ModuleFormer: Learning Modular Large Language Models From Uncurated Data
Large Language Models (LLMs) have achieved remarkable results. But exist...
research
∙
05/04/2023
Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervision
Recent AI-assistant agents, such as ChatGPT, predominantly rely on super...
research
∙
04/07/2023
Embodied Concept Learner: Self-supervised Learning of Concepts and Mapping through Instruction Following
Humans, even at a very early age, can learn visual concepts and understa...
research
∙
04/06/2023
Visual Dependency Transformers: Dependency Tree Emerges from Reversed Attention
Humans possess a versatile mechanism for extracting structured represent...
research
∙
03/20/2023
3D Concept Learning and Reasoning from Multi-View Images
Humans are able to accurately reason in 3D by gathering multi-view obser...
research
∙
03/09/2023
Planning with Large Language Models for Code Generation
Existing large language model-based code generation pipelines typically ...
research
∙
12/15/2022
Mod-Squad: Designing Mixture of Experts As Modular Multi-Task Learners
Optimization in multi-task learning (MTL) is more challenging than singl...
research
∙
10/17/2022
S^3-NeRF: Neural Reflectance Field from Shading and Shadow under a Single Viewpoint
In this paper, we address the "dual problem" of multi-view scene reconst...
research
∙
07/23/2022
PS-NeRF: Neural Inverse Rendering for Multi-view Photometric Stereo
Traditional multi-view photometric stereo (MVPS) methods are often compo...
research
∙
05/02/2022
ComPhy: Compositional Physical Reasoning of Objects and Events from Videos
Objects' motions in nature are governed by complex interactions and thei...
research
∙
02/15/2022
A Unified Framework for Masked and Mask-Free Face Recognition via Feature Rectification
Face recognition under ideal conditions is now considered a well-solved ...
research
∙
10/28/2021
Dynamic Visual Reasoning by Learning Differentiable Physics Models from Video and Language
In this work, we propose a unified framework, called Visual Reasoning wi...
research
∙
09/02/2021
Deep Face Video Inpainting via UV Mapping
This paper addresses the problem of face video inpainting. Existing vide...
research
∙
03/30/2021
Grounding Physical Concepts of Objects and Events Through Dynamic Visual Reasoning
We study the problem of dynamic visual reasoning on raw videos. This is ...
research
∙
03/24/2021
The Blessings of Unlabeled Background in Untrimmed Videos
Weakly-supervised Temporal Action Localization (WTAL) aims to detect the...
research
∙
03/01/2020
Cops-Ref: A new Dataset and Task on Compositional Referring Expression Comprehension
Referring expression comprehension (REF) aims at identifying a particula...
research
∙
01/25/2020
Look Closer to Ground Better: Weakly-Supervised Temporal Grounding of Sentence in Video
In this paper, we study the problem of weakly-supervised temporal ground...
research
∙
06/06/2019
Weakly-Supervised Spatio-Temporally Grounding Natural Sentence in Video
In this paper, we address a novel task, namely weakly-supervised spatio-...
research
∙
05/10/2018