research
∙
09/14/2023
OpenIllumination: A Multi-Illumination Dataset for Inverse Rendering Evaluation on Real Objects
We introduce OpenIllumination, a real-world dataset containing over 108K...
share
research
∙
07/25/2023
Strivec: Sparse Tri-Vector Radiance Fields
We propose Strivec, a novel neural representation that models a 3D scene...
research
∙
07/20/2023
Reparameterized Policy Learning for Multimodal Trajectory Optimization
We investigate the challenge of parametrizing policies for reinforcement...
research
∙
07/19/2023
3Deformer: A Common Framework for Image-Guided Mesh Deformation
We propose 3Deformer, a general-purpose framework for interactive 3D sha...
research
∙
07/06/2023
Distilling Large Vision-Language Model with Out-of-Distribution Generalizability
Large vision-language models have achieved outstanding performance, but ...
research
∙
06/29/2023
One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimization
Single image 3D reconstruction is an important but challenging task that...
research
∙
06/11/2023
On the Efficacy of 3D Point Cloud Reinforcement Learning
Recent studies on visual reinforcement learning (visual RL) have explore...
research
∙
06/06/2023
Deductive Verification of Chain-of-Thought Reasoning
Large Language Models (LLMs) significantly benefit from Chain-of-Thought...
research
∙
05/28/2023
KAFA: Rethinking Image Ad Understanding with Knowledge-Augmented Feature Adaptation of Vision-Language Models
Image ad understanding is a crucial task with wide real-world applicatio...
research
∙
05/26/2023
NeuManifold: Neural Watertight Manifold Reconstruction with Efficient and High-Quality Rendering Support
We present a method for generating high-quality watertight manifold mesh...
research
∙
05/18/2023
OpenShape: Scaling Up 3D Shape Representation Towards Open-World Understanding
We introduce OpenShape, a method for learning multi-modal joint represen...
research
∙
05/02/2023
EasyHeC: Accurate and Automatic Hand-eye Calibration via Differentiable Rendering and Space Exploration
Hand-eye calibration is a critical task in robotics, as it directly affe...
research
∙
04/24/2023
TensoIR: Tensorial Inverse Rendering
We propose TensoIR, a novel inverse rendering approach based on tensor f...
research
∙
04/13/2023
Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstruction
3D-aware image synthesis encompasses a variety of tasks, such as scene g...
research
∙
04/03/2023
Chain-of-Thought Predictive Control
We study generalizable policy learning from demonstrations for complex l...
research
∙
03/27/2023
DexDeform: Dexterous Deformable Object Manipulation with Human Demonstrations and Differentiable Physics
In this work, we aim to learn dexterous manipulation of deformable objec...
research
∙
03/23/2023
Boosting Reinforcement Learning and Planning with Demonstrations: A Survey
Although reinforcement learning has seen tremendous success recently, th...
research
∙
03/10/2023
MovingParts: Motion-based 3D Part Discovery in Dynamic Radiance Field
We present MovingParts, a NeRF-based method for dynamic scene reconstruc...
research
∙
03/06/2023
Nerflets: Local Radiance Fields for Efficient Structure-Aware 3D Scene Representation from 2D Supervision
We address efficient and structure-aware 3D scene representation from im...
research
∙
02/09/2023
ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skills
Generalizable manipulation skills, which can be composed to tackle long-...
research
∙
02/02/2023
Factor Fields: A Unified Framework for Neural Fields and Beyond
We present Factor Fields, a novel framework for modeling and representin...
research
∙
12/03/2022
PartSLIP: Low-Shot Part Segmentation for 3D Point Clouds via Pretrained Image-Language Models
Generalizable 3D part segmentation is important but challenging in visio...
research
∙
10/19/2022
On the Feasibility of Cross-Task Transfer with Model-Based Reinforcement Learning
Reinforcement Learning (RL) algorithms can solve challenging control pro...
research
∙
10/14/2022
LESS: Label-Efficient Semantic Segmentation for LiDAR Point Clouds
Semantic segmentation of LiDAR point clouds is an important task in auto...
research
∙
10/14/2022
Abstract-to-Executable Trajectory Translation for One-Shot Task Generalization
Training long-horizon robotic policies in complex physical environments ...
research
∙
10/14/2022
Frame Mining: a Free Lunch for Learning Robotic Manipulation from 3D Point Clouds
We study how choices of input point cloud coordinate frames impact learn...
research
∙
10/06/2022
A Real2Sim2Real Method for Robust Object Grasping with Neural Surface Reconstruction
Recent 3D-based manipulation methods either directly predict the grasp p...
research
∙
09/06/2022
Multi-skill Mobile Manipulation for Object Rearrangement
We study a modular approach to tackle long-horizon mobile manipulation t...
research
∙
06/26/2022
Improving Policy Optimization with Generalist-Specialist Learning
Generalization in deep reinforcement learning over unseen environment va...
research
∙
05/05/2022
Approximate Convex Decomposition for 3D Meshes with Collision-Aware Concavity and Tree Search
Approximate convex decomposition aims to decompose a 3D shape into a set...
research
∙
05/05/2022
Contact Points Discovery for Soft-Body Manipulations with Differentiable Physics
Differentiable physics has recently been shown as a powerful tool for so...
research
∙
04/21/2022
Provably Efficient Kernelized Q-Learning
We propose and analyze a kernelized version of Q-learning. Although a ke...
research
∙
03/21/2022
NeRFusion: Fusing Radiance Fields for Large-Scale Scene Reconstruction
While NeRF has shown great success for neural reconstruction and renderi...
research
∙
03/17/2022
TensoRF: Tensorial Radiance Fields
We present TensoRF, a novel approach to model and reconstruct radiance f...
research
∙
01/28/2022
Close the Visual Domain Gap by Physics-Grounded Active Stereovision Depth Sensor Simulation
In this paper, we focus on the simulation of active stereovision depth s...
research
∙
12/06/2021
ActiveZero: Mixed Domain Learning for Active Stereovision with Zero Annotation
Traditional depth sensors generate accurate real world depth estimates t...
research
∙
12/02/2021
FuseDream: Training-Free Text-to-Image Generation with Improved CLIP+GAN Space Optimization
Generating images from natural language instructions is an intriguing ye...
research
∙
10/10/2021
Vectorization of Raster Manga by Deep Reinforcement Learning
Manga is a popular Japanese-style comic form that consists of black-and-...
research
∙
07/30/2021
ManiSkill: Learning-from-Demonstrations Benchmark for Generalizable Manipulation Skills
Learning generalizable manipulation skills is central for robots to achi...
research
∙
06/29/2021
O2O-Afford: Annotation-Free Large-Scale Object-Object Affordance Learning
Contrary to the vast literature in modeling, perceiving, and understandi...
research
∙
06/22/2021
Particle Cloud Generation with Message Passing Generative Adversarial Networks
In high energy physics (HEP), jets are collections of correlated particl...
research
∙
05/28/2021
One-shot Learning with Absolute Generalization
One-shot learning is proposed to make a pretrained classifier workable o...
research
∙
04/23/2021
OCRTOC: A Cloud-Based Competition and Benchmark for Robotic Grasping and Manipulation
In this paper, we propose a cloud-based benchmark for robotic grasping a...
research
∙
04/08/2021
CAPTRA: CAtegory-level Pose Tracking for Rigid and Articulated Objects from Point Clouds
In this work, we tackle the problem of category-level online pose tracki...
research
∙
04/07/2021
PlasticineLab: A Soft-Body Manipulation Benchmark with Differentiable Physics
Simulated virtual environments serve as one of the main driving forces b...
research
∙
03/29/2021
GNeRF: GAN-based Neural Radiance Field without Posed Camera
We introduce GNeRF, a framework to marry Generative Adversarial Networks...
research
∙
03/29/2021
MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereo
We present MVSNeRF, a novel neural rendering approach that can efficient...
research
∙
03/01/2021
NeuTex: Neural Texture Mapping for Volumetric Neural Rendering
Recent work has demonstrated that volumetric scene representations combi...
research
∙
02/18/2021
DeepMetaHandles: Learning Deformation Meta-Handles of 3D Meshes with Biharmonic Coordinates
We propose DeepMetaHandles, a 3D conditional generative model based on m...
research
∙
01/01/2021