research
∙
06/26/2023
LongCoder: A Long-Range Pre-trained Language Model for Code Completion
In this paper, we introduce a new task for code completion that focuses ...
share
research
∙
06/15/2023
CMMLU: Measuring massive multitask language understanding in Chinese
As the capabilities of large language models (LLMs) continue to advance,...
research
∙
05/23/2023
Query Rewriting for Retrieval-Augmented Large Language Models
Large Language Models (LLMs) play a powerful Reader of the Retrieve-then...
research
∙
04/20/2023
Learning to Program with Natural Language
Large Language Models (LLMs) have shown remarkable performance in variou...
research
∙
04/03/2023
Baize: An Open-Source Chat Model with Parameter-Efficient Tuning on Self-Chat Data
Chat models, such as ChatGPT, have shown impressive capabilities and hav...
research
∙
03/29/2023
TaskMatrix.AI: Completing Tasks by Connecting Foundation Models with Millions of APIs
Artificial Intelligence (AI) has made incredible progress recently. On t...
research
∙
02/03/2023
Modeling Sequential Sentence Relation to Improve Cross-lingual Dense Retrieval
Recently multi-lingual pre-trained language models (PLM) such as mBERT a...
research
∙
12/22/2022
GENIE: Large Scale Pre-training for Text Generation with Diffusion Model
In this paper, we propose a large-scale language pre-training for text G...
research
∙
12/18/2022
Curriculum Sampling for Dense Retrieval with Document Expansion
The dual-encoder has become the de facto architecture for dense retrieva...
research
∙
12/15/2022
MASTER: Multi-task Pre-trained Bottlenecked Masked Autoencoders are Better Dense Retrievers
Dense retrieval aims to map queries and passages into low-dimensional ve...
research
∙
12/14/2022
APOLLO: An Optimized Training Approach for Long-form Numerical Reasoning
Long-form numerical reasoning in financial analysis aims to generate a r...
research
∙
11/25/2022
CodeExp: Explanatory Code Document Generation
Developing models that can automatically generate detailed code explanat...
research
∙
07/20/2022
NUWA-Infinity: Autoregressive over Autoregressive Generation for Infinite Visual Synthesis
In this paper, we present NUWA-Infinity, a generative model for infinite...
research
∙
06/28/2022
Joint Generator-Ranker Learning for Natural Language Generation
Due to exposure bias, most existing natural language generation (NLG) mo...
research
∙
06/17/2022
Bridge-Tower: Building Bridges Between Encoders in Vision-Language Representation Learning
Vision-Language (VL) models with the Two-Tower architecture have dominat...
research
∙
06/01/2022
DiVAE: Photorealistic Images Synthesis with Denoising Diffusion Decoder
Recently most successful image synthesis models are multi stage process ...
research
∙
03/17/2022
CodeReviewer: Pre-Training for Automating Code Review Activities
Code review is an essential part to software development lifecycle since...
research
∙
02/10/2022
NÜWA-LIP: Language Guided Image Inpainting with Defect-free VQGAN
Language guided image inpainting aims to fill in the defective regions o...
research
∙
11/24/2021
NÜWA: Visual Synthesis Pre-training for Neural visUal World creAtion
This paper presents a unified multimodal pre-trained model called NÜWA t...
research
∙
04/30/2021
GODIVA: Generating Open-DomaIn Videos from nAtural Descriptions
Generating videos from text is a challenging task due to its high comput...
research
∙
04/18/2021
CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval
Video-text retrieval plays an essential role in multi-modal research and...
research
∙
12/28/2020
Syntax-Enhanced Pre-trained Model
We study the problem of leveraging the syntactic structure of text to en...
research
∙
02/19/2020
CodeBERT: A Pre-Trained Model for Programming and Natural Languages
We present CodeBERT, a bimodal pre-trained model for programming languag...
research
∙
02/05/2020
K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters
We study the problem of injecting knowledge into large pre-trained model...
research
∙
01/13/2020
ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-training
In this paper, we present a new sequence-to-sequence pre-training model ...
research
∙
09/09/2019
