research
∙
07/19/2023
TokenFlow: Consistent Diffusion Features for Consistent Video Editing
The generative AI revolution has recently expanded to videos. Neverthele...
share
research
∙
06/15/2023
DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Data
Current perceptual similarity metrics operate at the level of pixels and...
research
∙
02/23/2023
Teaching CLIP to Count to Ten
Large vision-language models (VLMs), such as CLIP, learn rich joint imag...
research
∙
02/16/2023
MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generation
Recent advances in text-to-image generation with diffusion models presen...
research
∙
02/08/2023
Neural Congealing: Aligning Images to a Joint Semantic Atlas
We present Neural Congealing – a zero-shot self-supervised framework for...
research
∙
02/02/2023
SceneScape: Text-Driven Consistent Scene Generation
We propose a method for text-driven perpetual view generation – synthesi...
research
∙
11/22/2022
Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translation
Large-scale text-to-image generative models have been a revolutionary br...
research
∙
10/17/2022
Imagic: Text-Based Real Image Editing with Diffusion Models
Text-conditioned image editing has recently attracted considerable inter...
research
∙
05/11/2022
Diverse Video Generation from a Single Video
GANs are able to perform generation and manipulation tasks, trained on a...
research
∙
04/05/2022
Text2LIVE: Text-Driven Layered Image and Video Editing
We present a method for zero-shot, text-driven appearance manipulation i...
research
∙
01/02/2022
Splicing ViT Features for Semantic Appearance Transfer
We present a method for semantically transferring the visual appearance ...
research
∙
12/10/2021
Deep ViT Features as Dense Visual Descriptors
We leverage deep features extracted from a pre-trained Vision Transforme...
research
∙
09/23/2021
Layered Neural Atlases for Consistent Video Editing
We present a method that decomposes, or "unwraps", an input video into a...
research
∙
09/17/2021
Diverse Generation from a Single Video Made Possible
Most advanced video generation and manipulation methods train on a large...
research
∙
08/02/2021
Consistent Depth of Moving Objects in Video
We present a method to estimate depth of a dynamic scene, containing arb...
research
∙
05/14/2021
Omnimatte: Associating Objects and Their Effects in Video
Computer vision is increasingly effective at segmenting objects in image...
research
∙
09/16/2020
Layered Neural Rendering for Retiming People in Video
We present a method for retiming people in an ordinary, natural video—ma...
research
∙
04/13/2020
SpeedNet: Learning the Speediness in Videos
We wish to automatically predict the "speediness" of moving objects in v...
research
∙
03/13/2020
Semantic Pyramid for Image Generation
We present a novel GAN-based model that utilizes the space of deep featu...
research
∙
05/23/2019
Speech2Face: Learning the Face Behind a Voice
How much can we infer about a person's looks from the way they speak? In...
research
∙
05/02/2019
SinGAN: Learning a Generative Model from a Single Natural Image
We introduce SinGAN, an unconditional generative model that can be learn...
research
∙
04/25/2019
Learning the Depths of Moving People by Watching Frozen People
We present a method for predicting dense depth in scenarios where both a...
research
∙
09/14/2018
MoSculp: Interactive Visualization of Shape and Time
We present a system that allows users to visualize complex human motion ...
research
∙
04/10/2018
Looking to Listen at the Cocktail Party: A Speaker-Independent Audio-Visual Model for Speech Separation
We present a joint audio-visual model for isolating a single speech sign...
research
∙
12/21/2017
Smart, Sparse Contours to Represent and Edit Images
We study the problem of reconstructing an image from information stored ...
research
∙
09/06/2016