research
∙
09/02/2023
ModelScope-Agent: Building Your Customizable Agent System with Open-source Large Language Models
Large language models (LLMs) have recently demonstrated remarkable capab...
share
research
∙
08/29/2023
Evaluation and Analysis of Hallucination in Large Vision-Language Models
Large Vision-Language Models (LVLMs) have recently achieved remarkable s...
research
∙
08/07/2023
COPA: Efficient Vision-Language Pre-training Through Collaborative Object- and Patch-Text Alignment
Vision-Language Pre-training (VLP) methods based on object detection enj...
research
∙
07/17/2023
BUS:Efficient and Effective Vision-language Pre-training with Bottom-Up Patch Summarization
Vision Transformer (ViT) based Vision-Language Pre-training (VLP) models...
research
∙
07/04/2023
mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understanding
Document understanding refers to automatically extract, analyze and comp...
research
∙
06/19/2023
Vision Transformer with Attention Map Hallucination and FFN Compaction
Vision Transformer(ViT) is now dominating many vision tasks. The drawbac...
research
∙
06/07/2023
Youku-mPLUG: A 10 Million Large-scale Chinese Video-Language Dataset for Pre-training and Benchmarks
To promote the development of Vision-Language Pre-training (VLP) and mul...
research
∙
05/24/2023
Towards Adaptive Prefix Tuning for Parameter-Efficient Language Model Fine-tuning
Fine-tuning large pre-trained language models on various downstream task...
research
∙
05/08/2023
Vision Langauge Pre-training by Contrastive Learning with Cross-Modal Similarity Regulation
Cross-modal contrastive learning in vision language pretraining (VLP) fa...
research
∙
05/03/2023
Transforming Visual Scene Graphs to Image Captions
We propose to Transform Scene Graphs (TSG) into more descriptive caption...
research
∙
04/27/2023
mPLUG-Owl: Modularization Empowers Large Language Models with Multimodality
Large language models (LLMs) have demonstrated impressive zero-shot abil...
research
∙
04/16/2023
ChatPLUG: Open-Domain Generative Dialogue System with Internet-Augmented Instruction Tuning for Digital Human
In this paper, we present ChatPLUG, a Chinese open-domain dialogue syste...
research
∙
02/01/2023
mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video
Recent years have witnessed a big convergence of language, vision, and m...
research
∙
01/05/2023
Adaptively Clustering Neighbor Elements for Image Captioning
We design a novel global-local Transformer named Ada-ClustFormer (ACF) t...
research
∙
01/05/2023
Learning Trajectory-Word Alignments for Video-Language Tasks
Aligning objects with words plays a critical role in Image-Language BERT...
research
∙
12/30/2022
HiTeA: Hierarchical Temporal-Aware Video-Language Pre-training
Video-language pre-training has advanced the performance of various down...
research
∙
05/24/2022
mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections
Large-scale pretrained foundation models have been an emerging paradigm ...
research
∙
04/15/2022
Image Captioning In the Transformer Age
Image Captioning (IC) has achieved astonishing developments by incorpora...
research
∙
11/17/2021
Achieving Human Parity on Visual Question Answering
The Visual Question Answering (VQA) task utilizes both visual image and ...
research
∙
08/21/2021
Grid-VLP: Revisiting Grid Features for Vision-Language Pre-training
Existing approaches to vision-language pre-training (VLP) heavily rely o...
research
∙
06/03/2021
E2E-VLP: End-to-End Vision-Language Pre-training Enhanced by Visual Learning
Vision-language pre-training (VLP) on large-scale image-text pairs has a...
research
∙
05/25/2021
We Know What You Want: An Advertising Strategy Recommender System for Online Advertising
Advertising expenditures have become the major source of revenue for e-c...
research
∙
03/14/2021
SemVLP: Vision-Language Pre-training by Aligning Semantics at Multiple Levels
Vision-language pre-training (VLP) on large-scale image-text pairs has r...
research
∙
09/03/2020
Learning to Infer User Hidden States for Online Sequential Advertising
To drive purchase in online advertising, it is of the advertiser's great...
research
∙
08/20/2020
A Deep Prediction Network for Understanding Advertiser Intent and Satisfaction
For e-commerce platforms such as Taobao and Amazon, advertisers play an ...
research
∙
04/26/2020
Neural Topic Modeling with Bidirectional Adversarial Training
Recent years have witnessed a surge of interests of using neural topic m...
research
∙
03/25/2020
Adversarial Multi-Binary Neural Network for Multi-class Classification
Multi-class text classification is one of the key problems in machine le...
research
∙
03/25/2020
Learning Syntactic and Dynamic Selective Encoding for Document Summarization
Text summarization aims to generate a headline or a short summary consis...
research
∙
03/18/2020
Selective Attention Encoders by Syntactic Graph Convolutional Networks for Document Summarization
Abstractive text summarization is a challenging task, and one need to de...
research
∙
09/06/2019
Learning Alignment for Multimodal Emotion Recognition from Speech
Speech emotion recognition is a challenging problem because human convey...
research
∙
08/02/2019