research
∙
09/04/2023
Instant Continual Learning of Neural Radiance Fields
Neural radiance fields (NeRFs) have emerged as an effective method for n...
share
research
∙
07/27/2023
PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Tracking
We introduce PointOdyssey, a large-scale synthetic dataset, and data gen...
research
∙
07/11/2023
Efficient 3D Articulated Human Generation with Layered Surface Volumes
Access to high-quality and diverse 3D articulated digital human assets i...
research
∙
07/10/2023
Articulated 3D Head Avatar Generation using Text-to-Image Diffusion Models
The ability to generate diverse 3D articulated head avatars is vital to ...
research
∙
05/04/2023
Single-Shot Implicit Morphable Faces with Consistent Texture Parameterization
There is a growing demand for the accessible creation of high-quality 3D...
research
∙
05/01/2023
Learning Controllable Adaptive Simulation for Multi-resolution Physics
Simulating the time evolution of physical systems is pivotal in many sci...
research
∙
04/11/2023
PixelRNN: In-pixel Recurrent Neural Networks for End-to-end-optimized Perception with Neural Sensors
Conventional image sensors digitize high-resolution images at fast frame...
research
∙
04/05/2023
Generative Novel View Synthesis with 3D-Aware Diffusion Models
We present a diffusion-based model for 3D-aware generative novel view sy...
research
∙
03/21/2023
Compositional 3D Scene Generation using Locally Conditioned Diffusion
Designing complex 3D scenes has been a tedious, manual process requiring...
research
∙
03/21/2023
CC3D: Layout-Conditioned Generation of Compositional 3D Scenes
In this work, we introduce CC3D, a conditional generative model that syn...
research
∙
03/20/2023
DehazeNeRF: Multiple Image Haze Removal and 3D Shape Reconstruction using Neural Radiance Fields
Neural radiance fields (NeRFs) have demonstrated state-of-the-art perfor...
research
∙
03/14/2023
MELON: NeRF with Unposed Images Using Equivalence Class Estimation
Neural radiance fields enable novel-view synthesis and scene reconstruct...
research
∙
03/07/2023
Diffusion in the Dark: A Diffusion Model for Low-Light Text Recognition
Images are indispensable for the automation of high-level tasks, such as...
research
∙
02/02/2023
Towards Attention-aware Rendering for Virtual and Augmented Reality
Foveated graphics is a promising approach to solving the bandwidth chall...
research
∙
12/21/2022
PaletteNeRF: Palette-based Appearance Editing of Neural Radiance Fields
Recent advances in neural radiance fields have enabled the high-fidelity...
research
∙
12/16/2022
PointAvatar: Deformable Point-based Head Avatars from Videos
The ability to create realistic, animatable and relightable head avatars...
research
∙
12/08/2022
ALTO: Alternating Latent Topologies for Implicit 3D Reconstruction
This work introduces alternating latent topologies (ALTO) for high-fidel...
research
∙
11/30/2022
SinGRAF: Learning a 3D Generative Radiance Field for a Single Scene
Generative models have shown great promise in synthesizing photorealisti...
research
∙
11/22/2022
DiffDreamer: Consistent Single-view Perpetual View Generation with Conditional Diffusion Models
Perpetual view generation – the task of generating long-range novel view...
research
∙
10/13/2022
Amortized Inference for Heterogeneous Reconstruction in Cryo-EM
Cryo-electron microscopy (cryo-EM) is an imaging modality that provides ...
research
∙
09/29/2022
Heterogeneous reconstruction of deformable atomic models in Cryo-EM
Cryogenic electron microscopy (cryo-EM) provides a unique opportunity to...
research
∙
07/18/2022
NeuForm: Adaptive Overfitting for Neural Shape Editing
Neural representations are popular for representing shapes, as they can ...
research
∙
06/29/2022
3D-Aware Video Generation
Generative models have emerged as an essential building block for many i...
research
∙
06/01/2022
Learning to Solve PDE-constrained Inverse Problems with Graph Networks
Learned graph neural networks (GNNs) have recently been established as f...
research
∙
05/05/2022
Time-multiplexed Neural Holography: A flexible framework for holographic near-eye displays with fast heavily-quantized spatial light modulators
Holographic near-eye displays offer unprecedented capabilities for virtu...
research
∙
04/14/2022
Learning Spatially Varying Pixel Exposures for Motion Deblurring
Computationally removing the motion blur introduced by camera shake or o...
research
∙
03/25/2022
3D GAN Inversion for Controllable Portrait Image Animation
Millions of images of human faces are captured every single day; but the...
research
∙
03/15/2022
CryoAI: Amortized Inference of Poses for Ab Initio Reconstruction of 3D Molecular Volumes from Real Cryo-EM Images
Cryo-electron microscopy (cryo-EM) has become a tool of fundamental impo...
research
∙
12/15/2021
Efficient Geometry-aware 3D Generative Adversarial Networks
Unsupervised generation of high-quality multi-view-consistent images and...
research
∙
12/09/2021
MantissaCam: Learning Snapshot High-dynamic-range Imaging with Perceptually-based In-pixel Irradiance Encoding
The ability to image high-dynamic-range (HDR) scenes is crucial in many ...
research
∙
12/09/2021
BACON: Band-limited Coordinate Networks for Multiscale Scene Representation
Coordinate-based networks have emerged as a powerful tool for 3D represe...
research
∙
08/28/2021
Towards Retina-Quality VR Video Streaming: 15ms Could Save You 80 Your Bandwidth
Virtual reality systems today cannot yet stream immersive, retina-qualit...
research
∙
06/28/2021
Fast Training of Neural Lumigraph Representations using Meta Learning
Novel view synthesis is a long-standing problem in machine learning and ...
research
∙
05/06/2021
ACORN: Adaptive Coordinate Networks for Neural Scene Representation
Neural representations have emerged as a new paradigm for applications i...
research
∙
04/28/2021
A Perceptual Model for Eccentricity-dependent Spatio-temporal Flicker Fusion and its Applications to Foveated Graphics
Virtual and augmented reality (VR/AR) displays strive to provide a resol...
research
∙
04/06/2021
Time-Multiplexed Coded Aperture Imaging: Learned Coded Aperture and Pixel Exposures for Compressive Imaging Systems
Compressive imaging using coded apertures (CA) is a powerful technique t...
research
∙
03/25/2021
ScanGAN360: A Generative Model of Realistic Scanpaths for 360^∘ Images
Understanding and modeling the dynamics of human gaze behavior in 360^∘ ...
research
∙
03/22/2021
Neural Lumigraph Rendering
Novel view synthesis is a challenging and ill-posed inverse rendering pr...
research
∙
12/03/2020
AutoInt: Automatic Integration for Fast Neural Volume Rendering
Numerical integration is a foundational technique in scientific computin...
research
∙
12/02/2020
pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesis
We have witnessed rapid progress on 3D-aware image synthesis, leveraging...
research
∙
10/25/2020
SUREMap: Predicting Uncertainty in CNN-based Image Reconstruction Using Stein's Unbiased Risk Estimate
Convolutional neural networks (CNN) have emerged as a powerful tool for ...
research
∙
09/19/2020
Michelson Holography: Dual-SLM Holography with Camera-in-the-loop Optimization
We introduce Michelson Holography (MH), a holographic display technology...
research
∙
09/01/2020
End-to-End Hyperspectral-Depth Imaging with Learned Diffractive Optics
To extend the capabilities of spectral imaging, hyperspectral and depth ...
research
∙
06/17/2020
MetaSDF: Meta-learning Signed Distance Functions
Neural implicit shape representations are an emerging paradigm that offe...
research
∙
06/17/2020
Implicit Neural Representations with Periodic Activation Functions
Implicitly defined, continuous, differentiable signal representations pa...
research
∙
04/08/2020
State of the Art on Neural Rendering
Efficient rendering of photo-realistic virtual worlds is a long standing...
research
∙
04/07/2020
Event Based, Near Eye Gaze Tracking Beyond 10,000Hz
Fast and accurate eye tracking is crucial for many applications. Current...
research
∙
03/28/2020
Inferring Semantic Information with 3D Neural Scene Representations
Biological vision infers multi-modal 3D representations that support rea...
research
∙
02/14/2020
Deep S^3PR: Simultaneous Source Separation and Phase Retrieval Using Deep Generative Models
This paper introduces and solves the simultaneous source separation and ...
research
∙
12/13/2019