research
∙
08/25/2023
Nougat: Neural Optical Understanding for Academic Documents
Scientific knowledge is predominantly stored in books and scientific jou...
share
research
∙
08/24/2023
Code Llama: Open Foundation Models for Code
We release Code Llama, a family of large language models for code based ...
research
∙
07/18/2023
Llama 2: Open Foundation and Fine-Tuned Chat Models
In this work, we develop and release Llama 2, a collection of pretrained...
research
∙
02/15/2023
Augmented Language Models: a Survey
This survey reviews works in which language models (LMs) are augmented w...
research
∙
02/09/2023
Toolformer: Language Models Can Teach Themselves to Use Tools
Language models (LMs) exhibit remarkable abilities to solve new tasks fr...
research
∙
01/26/2023
LoRaLay: A Multilingual and Multimodal Dataset for Long Range and Layout-Aware Summarization
Text Summarization is a popular task and an active area of research for ...
research
∙
12/19/2022
Unnatural Instructions: Tuning Language Models with (Almost) No Human Labor
Instruction tuning enables pretrained language models to perform new tas...
research
∙
11/16/2022
Galactica: A Large Language Model for Science
Information overload is a major obstacle to scientific progress. The exp...
research
∙
11/02/2022
RQUGE: Reference-Free Metric for Evaluating Question Generation by Answering the Question
Existing metrics for evaluating the quality of automatically generated q...
research
∙
05/24/2022
Continual-T0: Progressively Instructing 50+ Tasks to Language Models Without Forgetting
Recent work on large language models relies on the intuition that most n...
research
∙
04/25/2022
Which Discriminator for Cooperative Text Generation?
Language models generate texts by successively predicting probability di...
research
∙
04/11/2022
TRUE: Re-evaluating Factual Consistency Evaluation
Grounded text generation systems often generate text that contains factu...
research
∙
01/28/2022
Generative Cooperative Networks for Natural Language Generation
Generative Adversarial Networks (GANs) have known a tremendous success f...
research
∙
10/18/2021
BEAMetrics: A Benchmark for Language Generation Evaluation Evaluation
Natural language processing (NLP) systems are increasingly trained to ge...
research
∙
09/02/2021
Skim-Attention: Learning to Focus via Document Layout
Transformer-based pre-training techniques of text and layout have proven...
research
∙
08/28/2021
QACE: Asking Questions to Evaluate an Image Caption
In this paper, we propose QACE, a new metric based on Question Answering...
research
∙
06/11/2021
To Beam Or Not To Beam: That is a Question of Cooperation for Language GANs
Due to the discrete nature of words, language GANs require to be optimiz...
research
∙
04/15/2021
Rethinking Automatic Evaluation in Sentence Simplification
Automatic evaluation remains an open research question in Natural Langua...
research
∙
04/15/2021
Data-QuestEval: A Referenceless Metric for Data to Text Semantic Evaluation
In this paper, we explore how QuestEval, which is a Text-vs-Text metric,...
research
∙
03/23/2021
SAFEval: Summarization Asks for Fact-based Evaluation
Summarization evaluation remains an open research problem: current metri...
research
∙
10/23/2020
Synthetic Data Augmentation for Zero-Shot Cross-Lingual Question Answering
Coupled with the availability of large scale datasets, deep learning arc...
research
∙
10/07/2020
Toward Stance-based Personas for Opinionated Dialogues
In the context of chit-chat dialogues it has been shown that endowing sy...
research
∙
07/02/2020
Project PIAF: Building a Native French Question-Answering Dataset
Motivated by the lack of data for non-English languages, in particular f...
research
∙
06/08/2020
ColdGANs: Taming Language GANs with Cautious Sampling Strategies
Training regimes based on Maximum Likelihood Estimation (MLE) suffer fro...
research
∙
04/30/2020
MLSUM: The Multilingual Summarization Corpus
We present MLSUM, the first large-scale MultiLingual SUMmarization datas...
research
∙
02/25/2020
BERT Can See Out of the Box: On the Cross-modal Transferability of Text Representations
Pre-trained language models such as BERT have recently contributed to si...
research
∙
02/24/2020
Discriminative Adversarial Search for Abstractive Summarization
We introduce a novel approach for sequence decoding, Discriminative Adve...
research
∙
11/08/2019
Ask to Learn: A Study on Curiosity-driven Question Generation
We propose a novel text generation task, namely Curiosity-driven Questio...
research
∙
09/04/2019