research
∙
08/26/2023
ORES: Open-vocabulary Responsible Visual Synthesis
Avoiding synthesizing specific visual concepts is an essential challenge...
share
research
∙
07/28/2023
Does Full Waveform Inversion Benefit from Big Data?
This paper investigates the impact of big data on deep learning models f...
research
∙
07/27/2023
Spatial-Frequency U-Net for Denoising Diffusion Probabilistic Models
In this paper, we study the denoising diffusion probabilistic model (DDP...
research
∙
06/30/2023
DisCo: Disentangled Control for Referring Human Dance Generation in Real World
Generative AI has made significant strides in computer vision, particula...
research
∙
06/07/2023
RefineVIS: Video Instance Segmentation with Temporal Attention Refinement
We introduce a novel framework called RefineVIS for Video Instance Segme...
research
∙
05/25/2023
Image is First-order Norm+Linear Autoregressive
This paper reveals that every image can be understood as a first-order n...
research
∙
05/22/2023
Conformal Inference for Invariant Risk Minimization
The application of machine learning models can be significantly impeded ...
research
∙
05/07/2023
Neural Voting Field for Camera-Space 3D Hand Pose Estimation
We present a unified framework for camera-space 3D hand pose estimation ...
research
∙
04/12/2023
Adaptive Human Matting for Dynamic Videos
The most recent efforts in video matting have focused on eliminating tri...
research
∙
04/10/2023
Binary Latent Diffusion
In this paper, we show that a binary latent space can be explored for co...
research
∙
03/25/2023
Equivariant Similarity for Vision-Language Foundation Models
This study explores the concept of equivariance in vision-language found...
research
∙
03/20/2023
MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Action
We propose MM-REACT, a system paradigm that integrates ChatGPT with a po...
research
∙
02/27/2023
Layer Grafted Pre-training: Bridging Contrastive Learning And Masked Image Modeling For Label-Efficient Representations
Recently, both Contrastive Learning (CL) and Mask Image Modeling (MIM) d...
research
∙
02/21/2023
Learning 3D Photography Videos via Self-supervised Diffusion on Single Images
3D photography renders a static image into a video with appealing 3D vis...
research
∙
02/02/2023
Energy-Inspired Self-Supervised Pretraining for Vision Models
Motivated by the fact that forward and backward passes of a deep network...
research
∙
12/01/2022
GRiT: A Generative Region-to-text Transformer for Object Understanding
This paper presents a Generative RegIon-to-Text transformer, GRiT, for o...
research
∙
11/24/2022
MPT: Mesh Pre-Training with Transformers for Human Pose and Mesh Reconstruction
We present Mesh Pre-Training (MPT), a new pre-training framework that le...
research
∙
11/23/2022
Self-Supervised Learning based on Heat Equation
This paper presents a new perspective of self-supervised learning based ...
research
∙
11/21/2022
Exploring Discrete Diffusion Models for Image Captioning
The image captioning task is typically realized by an auto-regressive me...
research
∙
10/17/2022
Vision-Language Pre-training: Basics, Recent Advances, and Future Trends
This paper surveys vision-language pre-training (VLP) methods for multim...
research
∙
09/04/2022
An Empirical Study of End-to-End Video-Language Transformers with Masked Visual Modeling
Masked visual modeling (MVM) has been recently proven effective for visu...
research
∙
07/20/2022
NUWA-Infinity: Autoregressive over Autoregressive Generation for Infinite Visual Synthesis
In this paper, we present NUWA-Infinity, a generative model for infinite...
research
∙
07/07/2022
Should All Proposals be Treated Equally in Object Detection?
The complexity-precision trade-off of an object detector is a critical p...
research
∙
06/15/2022
Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone
Vision-language (VL) pre-training has recently received considerable att...
research
∙
06/14/2022
LAVENDER: Unifying Video-Language Understanding as Masked Language Modeling
Unified vision-language frameworks have greatly advanced in recent years...
research
∙
06/14/2022
Consistent Video Instance Segmentation with Inter-Frame Recurrent Attention
Video instance segmentation aims at predicting object segmentation masks...
research
∙
05/27/2022
GIT: A Generative Image-to-text Transformer for Vision and Language
In this paper, we design and train a Generative Image-to-text Transforme...
research
∙
05/03/2022
Cross-modal Representation Learning for Zero-shot Action Recognition
We present a cross-modal Transformer-based framework, which jointly enco...
research
∙
04/28/2022
An Intriguing Property of Geophysics Inversion
Inversion techniques are widely used to reconstruct subsurface physical ...
research
∙
04/19/2022
ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models
Learning visual representations from natural language supervision has re...
research
∙
03/23/2022
Deep Frequency Filtering for Domain Generalization
Improving the generalization capability of Deep Neural Networks (DNNs) i...
research
∙
03/10/2022
The Overlooked Classifier in Human-Object Interaction Recognition
Human-Object Interaction (HOI) recognition is challenging due to two fac...
research
∙
02/03/2022
Exploring Multi-physics with Extremely Weak Supervision
Multi-physical inversion plays a critical role in geophysics. It has bee...
research
∙
01/25/2022
SA-VQA: Structured Alignment of Visual and Semantic Representations for Visual Question Answering
Visual Question Answering (VQA) attracts much attention from both indust...
research
∙
12/13/2021
Lifelong Unsupervised Domain Adaptive Person Re-identification with Coordinated Anti-forgetting and Adaptation
Unsupervised domain adaptive person re-identification (ReID) has been ex...
research
∙
12/13/2021
Decoupling Object Detection from Human-Object Interaction Recognition
We propose DEFR, a DEtection-FRee method to recognize Human-Object Inter...
research
∙
12/12/2021
Improving Vision Transformers for Incremental Learning
This paper studies using Vision Transformers (ViT) in class incremental ...
research
∙
12/09/2021
Injecting Semantic Concepts into End-to-End Image Captioning
Tremendous progress has been made in recent years in developing better i...
research
∙
12/08/2021
MLP Architectures for Vision-and-Language Modeling: An Empirical Study
We initiate the first empirical study on the use of MLP architectures fo...
research
∙
11/30/2021
MMPTRACK: Large-scale Densely Annotated Multi-camera Multiple People Tracking Benchmark
Multi-camera tracking systems are gaining popularity in applications tha...
research
∙
11/25/2021
SwinBERT: End-to-End Transformers with Sparse Attention for Video Captioning
The canonical approach to video captioning dictates a caption generation...
research
∙
11/24/2021
VIOLET : End-to-End Video-Language Transformers with Masked Visual-token Modeling
A great challenge in video-language (VidL) modeling lies in the disconne...
research
∙
11/24/2021
Scaling Up Vision-Language Pre-training for Image Captioning
In recent years, we have witnessed significant performance boost in the ...
research
∙
11/23/2021
Crossing the Format Boundary of Text and Boxes: Towards Unified Vision-Language Modeling
In this paper, we propose UNICORN, a vision-language (VL) model that uni...
research
∙
11/22/2021
Florence: A New Foundation Model for Computer Vision
Automated visual understanding of our diverse and open world demands com...
research
∙
11/19/2021
UFO: A UniFied TransfOrmer for Vision-Language Representation Learning
In this paper, we propose a single UniFied transfOrmer (UFO), which is c...
research
∙
11/13/2021
Physics-guided Loss Functions Improve Deep Learning Performance in Inverse Scattering
Solving electromagnetic inverse scattering problems (ISPs) is challengin...
research
∙
11/03/2021
An Empirical Study of Training End-to-End Vision-and-Language Transformers
Vision-and-language (VL) pre-training has proven to be highly effective ...
research
∙
10/14/2021
Unsupervised Learning of Full-Waveform Inversion: Connecting CNN and Partial Differential Equation in a Loop
This paper investigates unsupervised learning of Full-Waveform Inversion...
research
∙
09/10/2021