research
∙
08/23/2023
EVE: Efficient Vision-Language Pre-training with Masked Prediction and Modality-Aware MoE
Building scalable vision-language models to learn from diverse, multimod...
share
research
∙
05/25/2023
ChatBridge: Bridging Modalities with Large Language Model as a Language Catalyst
Building general-purpose models that can perceive diverse real-world mod...
research
∙
05/19/2023
Enhancing Vision-Language Pre-Training with Jointly Learned Questioner and Dense Captioner
Large pre-trained multimodal models have demonstrated significant succes...
research
∙
04/17/2023
VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset
In this paper, we propose a Vision-Audio-Language Omni-peRception pretra...
research
∙
10/09/2022
MAMO: Masked Multimodal Modeling for Fine-Grained Vision-Language Representation Learning
Multimodal representation learning has shown promising improvements on v...
research
∙
07/01/2021
OPT: Omni-Perception Pre-Trainer for Cross-Modal Understanding and Generation
In this paper, we propose an Omni-perception Pre-Trainer (OPT) for cross...
research
∙
01/26/2021
CPTR: Full Transformer Network for Image Captioning
In this paper, we consider the image captioning task from a new sequence...
research
∙
01/24/2021
Fast Sequence Generation with Multi-Agent Reinforcement Learning
Autoregressive sequence Generation models have achieved state-of-the-art...
research
∙
12/16/2020
AutoCaption: Image Captioning with Neural Architecture Search
Image captioning transforms complex visual information into abstract nat...
research
∙
05/10/2020
Non-Autoregressive Image Captioning with Counterfactuals-Critical Multi-Agent Learning
Most image captioning models are autoregressive, i.e. they generate each...
research
∙
03/19/2020
Normalized and Geometry-Aware Self-Attention Network for Image Captioning
Self-attention (SA) network has shown profound value in image captioning...
research
∙
10/17/2019
Multi-View Features and Hybrid Reward Strategies for Vatex Video Captioning Challenge 2019
This document describes our solution for the VATEX Captioning Challenge ...
research
∙
08/06/2019