research
∙
07/15/2023
INVE: Interactive Neural Video Editing
We present Interactive Neural Video Editing (INVE), a real-time video ed...
share
research
∙
12/06/2022
Perspective Fields for Single Image Camera Calibration
Geometric camera calibration is often required for applications that und...
research
∙
11/27/2022
3inGAN: Learning a 3D Generative Model from Images of a Self-similar Scene
We introduce 3inGAN, an unconditional 3D generative model trained from 2...
research
∙
11/22/2022
Videogenic: Video Highlights via Photogenic Moments
This paper investigates the challenge of extracting highlight moments fr...
research
∙
11/22/2022
VideoMap: Video Editing in Latent Space
Video has become a dominant form of media. However, video editing interf...
research
∙
07/29/2022
Towards Domain-agnostic Depth Completion
Existing depth completion methods are often targeted at a specific spars...
research
∙
05/30/2022
Neural Volumetric Object Selection
We introduce an approach for selecting objects in neural volumetric 3D r...
research
∙
05/22/2022
ReLU Fields: The Little Non-linearity That Could
In many recent works, multi-layer perceptions (MLPs) have been shown to ...
research
∙
09/23/2021
Layered Neural Atlases for Consistent Video Editing
We present a method that decomposes, or "unwraps", an input video into a...
research
∙
06/24/2021
GaussiGAN: Controllable Image Synthesis with 3D Gaussians from Unposed Silhouettes
We present an algorithm that learns a coarse 3D representation of object...
research
∙
05/11/2021
Differentiable Signal Processing With Black-Box Audio Effects
We present a data-driven approach to automate audio signal processing by...
research
∙
02/05/2021
CharacterGAN: Few-Shot Keypoint Character Animation and Reposing
We introduce CharacterGAN, a generative model that can be trained on onl...
research
∙
02/05/2021
Sampling Based Scene-Space Video Processing
Many compelling video processing effects can be achieved if per-pixel de...
research
∙
01/12/2021
DuctTake: Spatiotemporal Video Compositing
DuctTake is a system designed to enable practical compositing of multipl...
research
∙
12/17/2020
Learning to Recover 3D Scene Shape from a Single Image
Despite significant progress in monocular depth estimation in the wild, ...
research
∙
11/26/2020
Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenes
We present a method to perform novel view and time synthesis of dynamic ...
research
∙
11/02/2020
Revisiting Adaptive Convolutions for Video Frame Interpolation
Video frame interpolation, the synthesis of novel views in time, is an i...
research
∙
07/07/2020
Real-time Semantic Segmentation with Fast Attention
In deep CNN based models for semantic segmentation, high accuracy relies...
research
∙
07/01/2020
Swapping Autoencoder for Deep Image Manipulation
Deep generative models have become increasingly effective at producing r...
research
∙
04/03/2020
Temporally Distributed Networks for Fast Video Segmentation
We present TDNet, a temporally distributed network designed for fast and...
research
∙
04/03/2020
Temporally Distributed Networks for Fast Video Semantic Segmentation
We present TDNet, a temporally distributed network designed for fast and...
research
∙
03/25/2020
Improved Techniques for Training Single-Image GANs
Recently there has been an interest in the potential of learning generat...
research
∙
01/01/2020
Generating Object Stamps
We present an algorithm to generate diverse foreground objects and compo...
research
∙
12/23/2019
CNN-generated images are surprisingly easy to spot... for now
In this work we ask whether it is possible to create a "universal" detec...
research
∙
09/24/2019
Interactive Sketch & Fill: Multiclass Sketch-to-Image Translation
Arnab Ghosh 6:32 PM We propose an interactive GAN-based sketch-to-image ...
research
∙
06/13/2019
Detecting Photoshopped Faces by Scripting Photoshop
Most malicious photo manipulations are created using standard image edit...
research
∙
04/25/2019
Web Stereo Video Supervision for Depth Prediction from Dynamic Scenes
We present a fully data-driven method to compute depth from diverse mono...
research
∙
03/20/2019
Photometric Mesh Optimization for Video-Aligned 3D Object Reconstruction
In this paper, we address the problem of 3D object mesh reconstruction f...
research
∙
03/14/2019
MSG-GAN: Multi-Scale Gradient GAN for Stable Image Synthesis
While Generative Adversarial Networks (GANs) have seen huge successes in...
research
∙
02/28/2019
B-Script: Transcript-based B-roll Video Editing with Recommendations
In video production, inserting B-roll is a widely used technique to enri...
research
∙
01/14/2019
Joint Stabilization and Direction of 360°Videos
360 video provides an immersive experience for viewers, allowing them to...
research
∙
10/18/2018
DeepLens: Shallow Depth Of Field From A Single Image
We aim to generate high resolution shallow depth-of-field (DoF) images f...
research
∙
09/07/2018
Self-Supervised Generation of Spatial Audio for 360 Video
We introduce an approach to convert mono audio recorded by a 360 video c...
research
∙
09/05/2018
Localizing Moments in Video with Temporal Language
Localizing moments in a longer video via natural language queries is a n...
research
∙
08/01/2018
Learning Blind Video Temporal Consistency
Applying image processing algorithms independently to each frame of a vi...
research
∙
03/05/2018
ST-GAN: Spatial Transformer Generative Adversarial Networks for Image Compositing
We address the problem of finding realistic geometric corrections to a f...
research
∙
01/11/2018
The Unreasonable Effectiveness of Deep Features as a Perceptual Metric
While it is nearly effortless for humans to quickly assess the perceptua...
research
∙
11/30/2017
Toward Multimodal Image-to-Image Translation
Many image-to-image translation problems are ambiguous, as a single inpu...
research
∙
08/04/2017
Localizing Moments in Video with Natural Language
We consider retrieving a specific temporal segment, or moment, from a vi...
research
∙
11/30/2016
High-Resolution Image Inpainting using Multi-Scale Neural Patch Synthesis
Recent advances in deep learning have shown exciting promise in filling ...
research
∙
11/25/2016