research
∙
05/23/2023
i-Code Studio: A Configurable and Composable Framework for Integrative AI
Artificial General Intelligence (AGI) requires comprehensive understandi...
share
research
∙
05/21/2023
i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data
The convergence of text, visual, and audio data is a key step towards hu...
research
∙
10/23/2022
Retrieval Augmentation for Commonsense Reasoning: A Unified Approach
A common thread of retrieval-augmented methods in the existing literatur...
research
∙
05/03/2022
i-Code: An Integrative and Composable Multimodal Learning Framework
Human intelligence is multimodal; we integrate visual, linguistic, and a...
research
∙
10/16/2021
Leveraging Knowledge in Multilingual Commonsense Reasoning
Commonsense reasoning (CSR) requires the model to be equipped with gener...
research
∙
10/13/2021
Dict-BERT: Enhancing Language Model Pre-training with Dictionary
Pre-trained language models (PLMs) aim to learn universal language repre...
research
∙
10/08/2021
KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answering
Current Open-Domain Question Answering (ODQA) model paradigm often conta...
research
∙
09/01/2021
Does Knowledge Help General NLU? An Empirical Study
It is often observed in knowledge-centric tasks (e.g., common sense ques...
research
∙
05/14/2021
Joint Retrieval and Generation Training for Grounded Text Generation
Recent advances in large-scale pre-training such as GPT-3 allow seemingl...
research
∙
03/16/2021
LightningDOT: Pre-training Visual-Semantic Embeddings for Real-Time Image-Text Retrieval
Multimodal pre-training has propelled great advancement in vision-and-la...
research
∙
10/07/2020
Cross-Thought for Sentence Encoder Pre-training
In this paper, we propose Cross-Thought, a novel approach to pre-trainin...
research
∙
09/29/2020
Contrastive Distillation on Intermediate Representations for Language Model Compression
Existing language model compression methods mostly use a simple L2 loss ...
research
∙
09/13/2020
Cluster-Former: Clustering-based Sparse Transformer for Long-Range Dependency Encoding
Transformer has become ubiquitous in the deep learning field. One of the...
research
∙
09/10/2020
Accelerating Real-Time Question Answering via Question Generation
Existing approaches to real-time question answering (RTQA) rely on learn...
research
∙
09/10/2020
FILTER: An Enhanced Fusion Method for Cross-lingual Language Understanding
Large-scale cross-lingual language models (LM), such as mBERT, Unicoder ...
research
∙
11/09/2019
Hierarchical Graph Network for Multi-hop Question Answering
In this paper, we present Hierarchical Graph Network (HGN) for multi-hop...
research
∙
09/24/2018