research
∙
06/24/2023
DesCo: Learning Object Recognition with Rich Language Descriptions
Recent development in vision-language approaches has instigated a paradi...
share
research
∙
06/02/2023
MetaVL: Transferring In-Context Learning Ability From Language Models to Vision-Language Models
Large-scale language models have shown the ability to adapt to a new tas...
research
∙
06/12/2022
GLIPv2: Unifying Localization and Vision-Language Understanding
We present GLIPv2, a grounded VL understanding model, that serves both l...
research
∙
05/25/2022
DisinfoMeme: A Multimodal Dataset for Detecting Meme Intentionally Spreading Out Disinformation
Disinformation has become a serious problem on social media. In particul...
research
∙
05/24/2022
GeoMLAMA: Geo-Diverse Commonsense Probing on Multilingual Pre-Trained Language Models
Recent work has shown that Pre-trained Language Models (PLMs) have the a...
research
∙
05/23/2022
On the Paradox of Learning to Reason from Data
Logical reasoning is needed in a wide range of NLP tasks. Can a BERT mod...
research
∙
04/19/2022
ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models
Learning visual representations from natural language supervision has re...
research
∙
12/16/2021
RegionCLIP: Region-based Language-Image Pretraining
Contrastive language-image pretraining (CLIP) using image-text pairs has...
research
∙
12/16/2021
SGEITL: Scene Graph Enhanced Image-Text Learning for Visual Commonsense Reasoning
Answering complex questions about images is an ambitious goal for machin...
research
∙
12/07/2021
Grounded Language-Image Pre-training
This paper presents a grounded language-image pre-training (GLIP) model ...
research
∙
09/14/2021
Broaden the Vision: Geo-Diverse Visual Commonsense Reasoning
Commonsense is defined as the knowledge that is shared by everyone. Howe...
research
∙
08/10/2021
BERTHop: An Effective Vision-and-Language Model for Chest X-ray Disease Diagnosis
Vision-and-language(V L) models take image and text as input and learn...
research
∙
07/13/2021
How Much Can CLIP Benefit Vision-and-Language Tasks?
Most existing Vision-and-Language (V L) models rely on pre-trained vis...
research
∙
10/24/2020
Weakly-supervised VisualBERT: Pre-training without Parallel Images and Captions
Pre-trained contextual vision-and-language (V L) models have brought i...
research
∙
08/09/2019
VisualBERT: A Simple and Performant Baseline for Vision and Language
We propose VisualBERT, a simple and flexible framework for modeling a br...
research
∙
02/28/2019