research
∙
09/18/2023
LayoutNUWA: Revealing the Hidden Layout Expertise of Large Language Models
Graphic layout generation, a growing research field, plays a significant...
share
research
∙
08/26/2023
ORES: Open-vocabulary Responsible Visual Synthesis
Avoiding synthesizing specific visual concepts is an essential challenge...
research
∙
08/19/2023
GameEval: Evaluating LLMs on Conversational Games
The rapid advancements in large language models (LLMs) have presented ch...
research
∙
08/16/2023
DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectory
Controllable video generation has gained significant attention in recent...
research
∙
06/27/2023
Constructing Multilingual Code Search Dataset Using Neural Machine Translation
Code search is a task to find programming codes that semantically match ...
research
∙
06/27/2023
GroundNLQ @ Ego4D Natural Language Queries Challenge 2023
In this report, we present our champion solution for Ego4D Natural Langu...
research
∙
06/26/2023
LongCoder: A Long-Range Pre-trained Language Model for Code Completion
In this paper, we introduce a new task for code completion that focuses ...
research
∙
06/15/2023
CMMLU: Measuring massive multitask language understanding in Chinese
As the capabilities of large language models (LLMs) continue to advance,...
research
∙
05/31/2023
ManagerTower: Aggregating the Insights of Uni-Modal Experts for Vision-Language Representation Learning
Two-Tower Vision-Language (VL) models have shown promising improvements ...
research
∙
05/24/2023
Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergy
Large language models are powerful text processors and reasoners, but ar...
research
∙
05/24/2023
BeamSearchQA: Large Language Models are Strong Zero-Shot QA Solver
Open-domain question answering is a crucial task that often requires acc...
research
∙
05/23/2023
Query Rewriting for Retrieval-Augmented Large Language Models
Large Language Models (LLMs) play a powerful Reader of the Retrieve-then...
research
∙
05/22/2023
Machine-Created Universal Language for Cross-lingual Transfer
There are two types of approaches to solving cross-lingual transfer: mul...
research
∙
05/16/2023
AR-Diffusion: Auto-Regressive Diffusion Model for Text Generation
Diffusion models have gained significant attention in the realm of image...
research
∙
05/11/2023
PROM: A Phrase-level Copying Mechanism with Pre-training for Abstractive Summarization
Based on the remarkable achievements of pre-trained language models in a...
research
∙
05/08/2023
Code Execution with Pre-trained Language Models
Code execution is a fundamental aspect of programming language semantics...
research
∙
04/23/2023
Enhancing Chain-of-Thoughts Prompting with Iterative Bootstrapping in Large Language Models
Large language models (LLMs) can achieve highly effective performance on...
research
∙
04/20/2023
Learning to Program with Natural Language
Large Language Models (LLMs) have shown remarkable performance in variou...
research
∙
04/17/2023
Low-code LLM: Visual Programming over LLMs
Effectively utilizing LLMs for complex tasks is challenging, often invol...
research
∙
04/13/2023
AGIEval: A Human-Centric Benchmark for Evaluating Foundation Models
Evaluating the general abilities of foundation models to tackle human-le...
research
∙
04/03/2023
Baize: An Open-Source Chat Model with Parameter-Efficient Tuning on Self-Chat Data
Chat models, such as ChatGPT, have shown impressive capabilities and hav...
research
∙
03/29/2023
AnnoLLM: Making Large Language Models to Be Better Crowdsourced Annotators
Many natural language processing (NLP) tasks rely on labeled data to tra...
research
∙
03/29/2023
TaskMatrix.AI: Completing Tasks by Connecting Foundation Models with Millions of APIs
Artificial Intelligence (AI) has made incredible progress recently. On t...
research
∙
03/08/2023
Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Models
ChatGPT is attracting a cross-field interest as it provides a language i...
research
∙
02/21/2023
Learning 3D Photography Videos via Self-supervised Diffusion on Single Images
3D photography renders a static image into a video with appealing 3D vis...
research
∙
02/03/2023
Modeling Sequential Sentence Relation to Improve Cross-lingual Dense Retrieval
Recently multi-lingual pre-trained language models (PLM) such as mBERT a...
research
∙
02/01/2023
Synthetic Prompting: Generating Chain-of-Thought Demonstrations for Large Language Models
Large language models can perform various reasoning tasks by using chain...
research
∙
12/22/2022
GENIE: Large Scale Pre-training for Text Generation with Diffusion Model
In this paper, we propose a large-scale language pre-training for text G...
research
∙
12/18/2022
Curriculum Sampling for Dense Retrieval with Document Expansion
The dual-encoder has become the de facto architecture for dense retrieva...
research
∙
12/15/2022
MASTER: Multi-task Pre-trained Bottlenecked Masked Autoencoders are Better Dense Retrievers
Dense retrieval aims to map queries and passages into low-dimensional ve...
research
∙
12/14/2022
APOLLO: An Optimized Training Approach for Long-form Numerical Reasoning
Long-form numerical reasoning in financial analysis aims to generate a r...
research
∙
12/10/2022
LEAD: Liberal Feature-based Distillation for Dense Retrieval
Knowledge distillation is often used to transfer knowledge from a strong...
research
∙
11/25/2022
CodeExp: Explanatory Code Document Generation
Developing models that can automatically generate detailed code explanat...
research
∙
11/18/2022
GENIUS: Sketch-based Language Model Pre-training via Extreme and Selective Masking for Text Generation and Augmentation
We introduce GENIUS: a conditional text generation model using sketches ...
research
∙
11/17/2022
Execution-based Evaluation for Data Science Code Generation Models
Code generation models can benefit data scientists' productivity by auto...
research
∙
11/16/2022
An Efficient COarse-to-fiNE Alignment Framework @ Ego4D Natural Language Queries Challenge 2022
This technical report describes the CONE approach for Ego4D Natural Lang...
research
∙
10/21/2022
SimANS: Simple Ambiguous Negatives Sampling for Dense Text Retrieval
Sampling proper negatives from a large document pool is vital to effecti...
research
∙
10/21/2022
Metric-guided Distillation: Distilling Knowledge from the Metric to Ranker and Retriever for Generative Commonsense Reasoning
Commonsense generation aims to generate a realistic sentence describing ...
research
∙
10/20/2022
Disentangling Reasoning Capabilities from Language Models with Compositional Reasoning Transformers
This paper presents ReasonFormer, a unified reasoning framework for mirr...
research
∙
10/18/2022
Sentiment-Aware Word and Sentence Level Pre-training for Sentiment Analysis
Most existing pre-trained language representation models (PLMs) are sub-...
research
∙
10/18/2022
Soft-Labeled Contrastive Pre-training for Function-level Code Representation
Code contrastive pre-training has recently achieved significant progress...
research
∙
10/11/2022
Mixed-modality Representation Learning and Pre-training for Joint Table-and-Text Retrieval in OpenQA
Retrieving evidences from tabular and textual resources is essential for...
research
∙
09/27/2022
PROD: Progressive Distillation for Dense Retrieval
Knowledge distillation is an effective way to transfer knowledge from a ...
research
∙
09/22/2022
CONE: An Efficient COarse-to-fiNE Alignment Framework for Long Video Temporal Grounding
Video temporal grounding (VTG) targets to localize temporal moments in a...
research
∙
07/20/2022
NUWA-Infinity: Autoregressive over Autoregressive Generation for Infinite Visual Synthesis
In this paper, we present NUWA-Infinity, a generative model for infinite...
research
∙
06/28/2022
Joint Generator-Ranker Learning for Natural Language Generation
Due to exposure bias, most existing natural language generation (NLG) mo...
research
∙
06/17/2022
Bridge-Tower: Building Bridges Between Encoders in Vision-Language Representation Learning
Vision-Language (VL) models with the Two-Tower architecture have dominat...
research
∙
06/07/2022
Unsupervised Context Aware Sentence Representation Pretraining for Multi-lingual Dense Retrieval
Recent research demonstrates the effectiveness of using pretrained langu...
research
∙
06/01/2022
DiVAE: Photorealistic Images Synthesis with Denoising Diffusion Decoder
Recently most successful image synthesis models are multi stage process ...
research
∙
05/23/2022