research
∙
09/17/2023
Towards Debiasing Frame Length Bias in Text-Video Retrieval via Causal Intervention
Many studies focus on improving pretraining or developing new backbones ...
share
research
∙
08/26/2023
Empowering Dynamics-aware Text-to-Video Diffusion with Large Language Models
Text-to-video (T2V) synthesis has gained increasing attention in the com...
research
∙
08/18/2023
Invariant Training 2D-3D Joint Hard Samples for Few-Shot Point Cloud Recognition
We tackle the data scarcity challenge in few-shot point cloud recognitio...
research
∙
08/08/2023
Empowering Vision-Language Models to Follow Interleaved Vision-Language Instructions
Multimodal Large Language Models (MLLMs) have recently sparked significa...
research
∙
07/17/2023
Random Boxes Are Open-world Object Detectors
We show that classifiers trained with random region proposals achieve st...
research
∙
06/30/2023
DisCo: Disentangled Control for Referring Human Dance Generation in Real World
Generative AI has made significant strides in computer vision, particula...
research
∙
06/12/2023
Fast Diffusion Model
Despite their success in real data synthesis, diffusion models (DMs) oft...
research
∙
06/07/2023
An Overview of Challenges in Egocentric Text-Video Retrieval
Text-video retrieval contains various challenges, including biases comin...
research
∙
05/23/2023
Decoupled Kullback-Leibler Divergence Loss
In this paper, we delve deeper into the Kullback-Leibler (KL) Divergence...
research
∙
03/25/2023
Equivariant Similarity for Vision-Language Foundation Models
This study explores the concept of equivariance in vision-language found...
research
∙
03/22/2023
Unbiased Multiple Instance Learning for Weakly Supervised Video Anomaly Detection
Weakly Supervised Video Anomaly Detection (WSVAD) is challenging because...
research
∙
03/17/2023
Semantic Scene Completion with Cleaner Self
Semantic Scene Completion (SSC) transforms an image of single-view depth...
research
∙
01/29/2023
Debiased Fine-Tuning for Vision-language Models by Prompt Regularization
We present a new paradigm for fine-tuning large-scale visionlanguage pre...
research
∙
01/05/2023
Adaptively Clustering Neighbor Elements for Image Captioning
We design a novel global-local Transformer named Ada-ClustFormer (ACF) t...
research
∙
01/05/2023
Learning Trajectory-Word Alignments for Video-Language Tasks
Aligning objects with words plays a critical role in Image-Language BERT...
research
∙
11/23/2022
Evaluating and Mitigating Static Bias of Action Representations in the Background and the Foreground
Deep neural networks for video action recognition easily learn to utiliz...
research
∙
11/20/2022
Attention-based Class Activation Diffusion for Weakly-Supervised Semantic Segmentation
Extracting class activation maps (CAM) is a key step for weakly-supervis...
research
∙
10/23/2022
Respecting Transfer Gap in Knowledge Distillation
Knowledge distillation (KD) is essentially a process of transferring a t...
research
∙
10/04/2022
Learning to Collocate Visual-Linguistic Neural Modules for Image Captioning
Humans tend to decompose a sentence into different parts like sth do sth...
research
∙
08/06/2022
Class Is Invariant to Context and Vice Versa: On Learning Invariance for Out-Of-Distribution Generalization
Out-Of-Distribution generalization (OOD) is all about learning invarianc...
research
∙
07/27/2022
Identifying Hard Noise in Long-Tailed Sample Distribution
Conventional de-noising methods rely on the assumption that all samples ...
research
∙
07/27/2022
NICEST: Noisy Label Correction and Training for Robust Scene Graph Generation
Nearly all existing scene graph generation (SGG) models have overlooked ...
research
∙
07/25/2022
Equivariance and Invariance Inductive Bias for Learning from Insufficient Data
We are interested in learning robust models from insufficient data, with...
research
∙
07/19/2022
Invariant Feature Learning for Generalized Long-Tailed Classification
Existing long-tailed classification (LT) methods only focus on tackling ...
research
∙
06/29/2022
On Non-Random Missing Labels in Semi-Supervised Learning
Semi-Supervised Learning (SSL) is fundamentally a missing label problem,...
research
∙
06/29/2022
Exploiting Semantic Role Contextualized Video Features for Multi-Instance Text-Video Retrieval EPIC-KITCHENS-100 Multi-Instance Retrieval Challenge 2022
In this report, we present our approach for EPIC-KITCHENS-100 Multi-Inst...
research
∙
06/26/2022
RoME: Role-aware Mixture-of-Expert Transformer for Text-to-Video Retrieval
Seas of videos are uploaded daily with the popularity of social channels...
research
∙
05/30/2022
Prompt-aligned Gradient for Prompt Tuning
Thanks to the large pre-trained vision-language models (VLMs) like CLIP,...
research
∙
05/24/2022
Certified Robustness Against Natural Language Attacks by Causal Intervention
Deep learning models have achieved great success in many fields, yet the...
research
∙
03/02/2022
Class Re-Activation Maps for Weakly-Supervised Semantic Segmentation
Extracting class activation maps (CAM) is arguably the most standard ste...
research
∙
12/31/2021
Deconfounded Visual Grounding
We focus on the confounding bias between language and location in the vi...
research
∙
12/29/2021
Cross-Domain Empirical Risk Minimization for Unbiased Long-tailed Classification
We address the overlooked unbiasedness in existing long-tailed classific...
research
∙
12/22/2021
How Should Pre-Trained Language Models Be Fine-Tuned Towards Adversarial Robustness?
The fine-tuning of pre-trained language models has a great success in ma...
research
∙
11/01/2021
Introspective Distillation for Robust Question Answering
Question answering (QA) models are well-known to exploit data bias, e.g....
research
∙
10/28/2021
Self-Supervised Learning Disentangled Group Representation as Feature
A good visual representation is an inference map from observations (imag...
research
∙
10/03/2021
Counterfactual Samples Synthesizing and Training for Robust Visual Question Answering
Today's VQA models still tend to capture superficial linguistic correlat...
research
∙
08/24/2021
Auto-Parsing Network for Image Captioning and Visual Question Answering
We propose an Auto-Parsing Network (APN) to discover and exploit the inp...
research
∙
08/19/2021
Causal Attention for Unbiased Visual Recognition
Attention module does not always help deep models learn causal features ...
research
∙
07/23/2021
Transporting Causal Mechanisms for Unsupervised Domain Adaptation
Existing Unsupervised Domain Adaptation (UDA) literature adopts the cova...
research
∙
06/17/2021
Adversarial Visual Robustness by Causal Intervention
Adversarial training is the de facto most promising defense against adve...
research
∙
06/06/2021
Empowering Language Understanding with Counterfactual Reasoning
Present language understanding methods have demonstrated extraordinary a...
research
∙
05/12/2021
VL-NMS: Breaking Proposal Bottlenecks in Two-Stage Visual-Language Matching
The prevailing framework for matching multimodal inputs is based on a tw...
research
∙
04/15/2021
TransferNet: An Effective and Transparent Framework for Multi-hop Question Answering over Relation Graph
Multi-hop Question Answering (QA) is a challenging task because it requi...
research
∙
03/24/2021
The Blessings of Unlabeled Background in Untrimmed Videos
Weakly-supervised Temporal Action Localization (WTAL) aims to detect the...
research
∙
03/05/2021
Causal Attention for Vision-Language Tasks
We present a novel attention mechanism: Causal Attention (CATT), to remo...
research
∙
03/02/2021
Distilling Causal Effect of Data in Class-Incremental Learning
We propose a causal framework to explain the catastrophic forgetting in ...
research
∙
03/01/2021
Counterfactual Zero-Shot and Open-Set Visual Recognition
We present a novel counterfactual framework for both Zero-Shot Learning ...
research
∙
09/28/2020
Interventional Few-Shot Learning
We uncover an ever-overlooked deficiency in the prevailing Few-Shot Lear...
research
∙
09/28/2020
Long-Tailed Classification by Keeping the Good and Removing the Bad Momentum Causal Effect
As the class size grows, maintaining a balanced dataset across many clas...
research
∙
09/26/2020