research
∙
09/18/2023
Unsupervised Open-Vocabulary Object Localization in Videos
In this paper, we show that recent advances in video representation lear...
share
research
∙
09/18/2023
Spiking-LEAF: A Learnable Auditory front-end for Spiking Neural Networks
Brain-inspired spiking neural networks (SNNs) have demonstrated great po...
research
∙
09/15/2023
SCT: A Simple Baseline for Parameter-Efficient Fine-Tuning via Salient Channels
Pre-trained vision transformers have strong representation benefits to v...
research
∙
08/20/2023
ViT-Lens: Towards Omni-modal Representations
Though the success of CLIP-based training recipes in vision-language mod...
research
∙
08/19/2023
Recap: Detecting Deepfake Video with Unpredictable Tampered Traces via Recovering Faces and Mapping Recovered Faces
The exploitation of Deepfake techniques for malicious intentions has dri...
research
∙
08/13/2023
Free-ATM: Exploring Unsupervised Learning on Diffusion-Generated Images with Free Attention Masks
Despite the rapid advancement of unsupervised learning in visual represe...
research
∙
08/12/2023
Revisiting Vision Transformer from the View of Path Ensemble
Vision Transformers (ViTs) are normally regarded as a stack of transform...
research
∙
08/11/2023
DatasetDM: Synthesizing Data with Perception Annotations Using Diffusion Models
Current deep networks are very data-hungry and benefit from training on ...
research
∙
07/20/2023
BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusion
Recent text-to-image diffusion models have demonstrated an astonishing c...
research
∙
07/11/2023
EgoVLPv2: Egocentric Video-Language Pre-training with Fusion in the Backbone
Video-language pre-training (VLP) has become increasingly important due ...
research
∙
06/27/2023
GroundNLQ @ Ego4D Natural Language Queries Challenge 2023
In this report, we present our champion solution for Ego4D Natural Langu...
research
∙
06/22/2023
TaCA: Upgrading Your Visual Foundation Model with Task-agnostic Compatible Adapter
Visual foundation models like CLIP excel in learning feature representat...
research
∙
06/14/2023
AssistGPT: A General Multi-modal Assistant that can Plan, Execute, Inspect, and Learn
Recent research on Large Language Models (LLMs) has led to remarkable ad...
research
∙
05/31/2023
Too Large; Data Reduction for Vision-Language Pre-Training
This paper examines the problems of severe image-text misalignment and h...
research
∙
05/29/2023
Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Models
Public large-scale text-to-image diffusion models, such as Stable Diffus...
research
∙
05/23/2023
VisorGPT: Learning Visual Prior via Generative Pre-Training
Various stuff and things in visual data possess specific traits, which c...
research
∙
04/24/2023
HOSNeRF: Dynamic Human-Object-Scene Neural Radiance Fields from a Single Video
We introduce HOSNeRF, a novel 360 free-viewpoint rendering method that r...
research
∙
04/17/2023
Open-World Weakly-Supervised Object Localization
While remarkable success has been achieved in weakly-supervised object l...
research
∙
04/07/2023
SparseFormer: Sparse Visual Recognition via Limited Latent Tokens
Human visual recognition is a sparse process, where only a few salient v...
research
∙
03/26/2023
Affordance Grounding from Demonstration Video to Target Image
Humans excel at learning from expert demonstrations and solving their ow...
research
∙
03/21/2023
DiffuMask: Synthesizing Images with Pixel-level Annotations for Semantic Segmentation Using Diffusion Models
Collecting and annotating images with pixel-wise labels is time-consumin...
research
∙
03/14/2023
Revisit Parameter-Efficient Transfer Learning: A Two-Stage Paradigm
Parameter-Efficient Transfer Learning (PETL) aims at efficiently adaptin...
research
∙
03/03/2023
Mover: Mask and Recovery based Facial Part Consistency Aware Method for Deepfake Video Detection
Deepfake techniques have been widely used for malicious purposes, prompt...
research
∙
02/16/2023
Object-centric Learning with Cyclic Walks between Parts and Whole
Learning object-centric representations from complex natural environment...
research
∙
01/08/2023
STPrivacy: Spatio-Temporal Tubelet Sparsification and Anonymization for Privacy-preserving Action Recognition
Recently privacy-preserving action recognition (PPAR) has been becoming ...
research
∙
12/22/2022
Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation
To reproduce the success of text-to-image (T2I) generation, recent works...
research
∙
12/19/2022
Position-guided Text Prompt for Vision-Language Pre-training
Vision-Language Pre-Training (VLP) has shown promising capabilities to a...
research
∙
12/19/2022
MIST: Multi-modal Iterative Spatial-Temporal Transformer for Long-form Video Question Answering
To build Video Question Answering (VideoQA) systems capable of assisting...
research
∙
12/13/2022
PV3D: A 3D Generative Model for Portrait Video Generation
Recent advances in generative adversarial networks (GANs) have demonstra...
research
∙
12/06/2022
Rethinking the Objectives of Vector-Quantized Tokenizers for Image Synthesis
Vector-Quantized (VQ-based) generative models usually consist of two bas...
research
∙
11/28/2022
Learning to Learn: How to Continuously Teach Humans and Machines
Our education system comprises a series of curricula. For example, when ...
research
∙
10/13/2022
Darwinian Model Upgrades: Model Evolving with Selective Compatibility
The traditional model upgrading paradigm for retrieval requires recomput...
research
∙
08/24/2022
Symbolic Replay: Scene Graph as Prompt for Continual Learning on VQA Task
VQA is an ambitious task aiming to answer any image-related question. Ho...
research
∙
08/18/2022
Single-Stage Open-world Instance Segmentation with Cross-task Consistency Regularization
Open-world instance segmentation (OWIS) aims to segment class-agnostic i...
research
∙
06/14/2022
Sense The Physical, Walkthrough The Virtual, Manage The Metaverse: A Data-centric Perspective
In the Metaverse, the physical space and the virtual space co-exist, and...
research
∙
06/05/2022
Towards Fast Adaptation of Pretrained Contrastive Models for Multi-channel Video-Language Retrieval
Multi-channel video-language retrieval require models to understand info...
research
∙
06/01/2022
Label-Efficient Online Continual Object Detection in Streaming Video
To thrive in evolving environments, humans are capable of continual acqu...
research
∙
05/31/2022
DeVRF: Fast Deformable Voxel Radiance Fields for Dynamic Scenes
Modeling dynamic scenes is important for many applications such as virtu...
research
∙
05/31/2022
Novel View Synthesis for High-fidelity Headshot Scenes
Rendering scenes with a high-quality human face from arbitrary viewpoint...
research
∙
04/01/2022
Generic Event Boundary Captioning: A Benchmark for Status Changes Understanding
Cognitive science has shown that humans perceive videos in terms of even...
research
∙
03/29/2022
Unified Transformer Tracker for Object Tracking
As an important area in computer vision, object tracking has formed two ...
research
∙
03/08/2022
AssistQ: Affordance-centric Question-driven Task Completion for Egocentric Assistant
A long-standing goal of intelligent assistants such as AR glasses/robots...
research
∙
11/30/2021
AssistSR: Affordance-centric Question-driven Video Segment Retrieval
It is still a pipe dream that AI assistants on phone and AR glasses can ...
research
∙
11/29/2021
AVA-AVD: Audio-visual Speaker Diarization in the Wild
Audio-visual speaker diarization aims at detecting “who spoken when“ usi...
research
∙
11/24/2021
MorphMLP: A Self-Attention Free, MLP-Like Backbone for Image and Video
Self-attention has become an integral component of the recent network ar...
research
∙
09/13/2021
On Pursuit of Designing Multi-modal Transformer for Video Grounding
Video grounding aims to localize the temporal segment corresponding to a...
research
∙
08/12/2021
Deep Motion Prior for Weakly-Supervised Temporal Action Localization
Weakly-Supervised Temporal Action Localization (WSTAL) aims to localize ...
research
∙
07/14/2021
Is Someone Speaking? Exploring Long-term Temporal Features for Audio-visual Active Speaker Detection
Active speaker detection (ASD) seeks to detect who is speaking in a visu...
research
∙
01/26/2021