research
∙
08/31/2023
Socratis: Are large multimodal models emotionally aware?
Existing emotion prediction benchmarks contain coarse emotion labels whi...
share
research
∙
08/24/2023
Label Budget Allocation in Multi-Task Learning
The cost of labeling data often limits the performance of machine learni...
research
∙
08/08/2023
From Fake to Real (FFR): A two-stage training pipeline for mitigating spurious correlations with synthetic data
Visual recognition models are prone to learning spurious correlations in...
research
∙
08/03/2023
DualCoOp++: Fast and Effective Adaptation to Multi-Label Recognition with Limited Annotations
Multi-label image recognition in the low-label regime is a task of great...
research
∙
07/24/2023
Multiscale Video Pretraining for Long-Term Activity Forecasting
Long-term activity forecasting is an especially challenging research pro...
research
∙
06/30/2023
Hardwiring ViT Patch Selectivity into CNNs using Patch Mixing
Vision transformers (ViTs) have significantly changed the computer visio...
research
∙
05/09/2023
WikiWeb2M: A Page-Level Multimodal Wikipedia Dataset
Webpages have been a rich resource for language and vision-language task...
research
∙
05/05/2023
COLA: How to adapt vision-language models to Compose Objects Localized with Attributes?
Compositional reasoning is a hallmark of human visual intelligence; yet ...
research
∙
05/05/2023
A Suite of Generative Tasks for Multi-Level Multimodal Webpage Understanding
Webpages have been a rich, scalable resource for vision-language and lan...
research
∙
04/04/2023
ERM++: An Improved Baseline for Domain Generalization
Multi-source Domain Generalization (DG) measures a classifier's ability ...
research
∙
03/31/2023
DIME-FM: DIstilling Multimodal and Efficient Foundation Models
Large Vision-Language Foundation Models (VLFM), such as CLIP, ALIGN and ...
research
∙
03/28/2023
Language-Guided Audio-Visual Source Separation via Trimodal Consistency
We propose a self-supervised approach for learning to perform audio sour...
research
∙
03/26/2023
VisDA 2022 Challenge: Domain Adaptation for Industrial Waste Sorting
Label-efficient and reliable semantic segmentation is essential for many...
research
∙
03/26/2023
Mind the Backbone: Minimizing Backbone Distortion for Robust Object Detection
Building object detectors that are robust to domain shifts is critical f...
research
∙
02/10/2023
MaskSketch: Unpaired Structure-guided Masked Image Generation
Recent conditional image generation methods produce images of remarkable...
research
∙
02/06/2023
Pic2Word: Mapping Pictures to Words for Zero-shot Composed Image Retrieval
In Composed Image Retrieval (CIR), a user combines a query image with te...
research
∙
01/17/2023
The SwaNNFlight System: On-the-Fly Sim-to-Real Adaptation via Anchored Learning
Reinforcement Learning (RL) agents trained in simulated environments and...
research
∙
11/29/2022
Finding Differences Between Transformers and ConvNets Using Counterfactual Simulation Testing
Modern deep neural networks tend to be evaluated on static test sets. On...
research
∙
11/27/2022
Exploring Consistency in Cross-Domain Transformer for Domain Adaptive Semantic Segmentation
While transformers have greatly boosted performance in semantic segmenta...
research
∙
11/22/2022
Human Evaluation of Text-to-Image Models on a Multi-Task Benchmark
We provide a new multi-task benchmark for evaluating text-to-image model...
research
∙
09/30/2022
Bias Mimicking: A Simple Sampling Approach for Bias Mitigation
Prior work has shown that Visual Recognition datasets frequently under-r...
research
∙
09/08/2022
FETA: Towards Specializing Foundation Models for Expert Task Applications
Foundation Models (FMs) have demonstrated unprecedented capabilities inc...
research
∙
07/26/2022
NewsStories: Illustrating articles with visual summaries
Recent self-supervised approaches have used large-scale image-text datas...
research
∙
06/20/2022
DualCoOp: Fast Adaptation to Multi-Label Recognition with Limited Annotations
Solving multi-label recognition (MLR) for images in the low-label regime...
research
∙
06/02/2022
Prefix Conditioning Unifies Language and Label Supervision
Vision-language contrastive learning suggests a new learning paradigm by...
research
∙
04/25/2022
Temporal Relevance Analysis for Video Action Models
In this paper, we provide a deep analysis of temporal modeling for actio...
research
∙
04/07/2022
Many-to-many Splatting for Efficient Video Frame Interpolation
Motion-based video frame interpolation commonly relies on optical flow t...
research
∙
04/01/2022
A Unified Framework for Domain Adaptive Pose Estimation
While pose estimation is an important computer vision task, it requires ...
research
∙
03/22/2022
A Broad Study of Pre-training for Domain Generalization and Adaptation
Deep models must learn robust and transferable representations in order ...
research
∙
02/04/2022
Interactive Mobile App Navigation with Uncertain or Under-specified Natural Language Commands
We introduce Mobile app Tasks with Iterative Feedback (MoTIF), a new dat...
research
∙
01/29/2022
Explaining Reinforcement Learning Policies through Counterfactual Trajectories
In order for humans to confidently decide where to employ RL agents for ...
research
∙
12/09/2021
Extending the WILDS Benchmark for Unsupervised Adaptation
Machine learning systems deployed in the wild are often trained on a sou...
research
∙
12/04/2021
Unsupervised Domain Generalization by Learning a Bridge Across Domains
The ability to generalize learned representations across significantly d...
research
∙
12/03/2021
Learning to Detect Every Thing in an Open World
Many open-world applications require the detection of novel objects, yet...
research
∙
11/30/2021
Task2Sim : Towards Effective Pre-training and Transfer from Synthetic Data
Pre-training models on Imagenet or other massive datasets of real images...
research
∙
11/26/2021
Disentangled Unsupervised Image Translation via Restricted Information Flow
Unsupervised image-to-image translation methods aim to map images from o...
research
∙
10/28/2021
Contrast and Mix: Temporal Contrastive Video Domain Adaptation with Background Mixing
Unsupervised domain adaptation which aims to adapt models trained on a l...
research
∙
10/20/2021
Look at What I'm Doing: Self-Supervised Spatial Grounding of Narrations in Instructional Videos
We introduce the task of spatially localizing narrated interactions in v...
research
∙
08/26/2021
Learning Cross-modal Contrastive Features for Video Domain Adaptation
Learning transferable and domain adaptive feature representations from v...
research
∙
08/24/2021
Tune it the Right Way: Unsupervised Validation of Domain Adaptation via Soft Neighborhood Density
Unsupervised domain adaptation (UDA) methods can dramatically improve ge...
research
∙
08/23/2021
Dynamic Network Quantization for Efficient Video Inference
Deep convolutional networks have recently achieved great success in vide...
research
∙
08/10/2021
MetaPose: Fast 3D Pose from Multiple Views without 3D Supervision
Recently, huge strides were made in monocular and multi-view pose estima...
research
∙
07/23/2021
VisDA-2021 Competition Universal Domain Adaptation to Improve Performance on Out-of-Distribution Data
Progress in machine learning is typically measured by training and testi...
research
∙
07/19/2021
Separating Skills and Concepts for Novel Visual Question Answering
Generalization to out-of-distribution data has been a problem for Visual...
research
∙
06/04/2021
ZeroWaste Dataset: Towards Automated Waste Recycling
Less than 35 leads to increased soil and sea pollution and is one of the...
research
∙
05/28/2021
OpenMatch: Open-set Consistency Regularization for Semi-supervised Learning with Outliers
Semi-supervised learning (SSL) is an effective means to leverage unlabel...
research
∙
05/11/2021
AdaMML: Adaptive Multi-Modal Learning for Efficient Video Recognition
Multi-modal learning, which focuses on utilizing various modalities to i...
research
∙
04/20/2021
Detector-Free Weakly Supervised Grounding by Separation
Nowadays, there is an abundance of data involving images and surrounding...
research
∙
04/17/2021
Mobile App Tasks with Iterative Feedback (MoTIF): Addressing Task Feasibility in Interactive Visual Environments
In recent years, vision-language research has shifted to study tasks whi...
research
∙
04/07/2021
