research
∙
09/20/2023
Chain-of-Verification Reduces Hallucination in Large Language Models
Generation of plausible yet incorrect factual information, termed halluc...
share
research
∙
08/08/2023
Shepherd: A Critic for Language Model Generation
As large language models improve, there is increasing interest in techni...
research
∙
07/24/2023
RLCD: Reinforcement Learning from Contrast Distillation for Language Model Alignment
We propose Reinforcement Learning from Contrast Distillation (RLCD), a m...
research
∙
06/26/2023
Understanding In-Context Learning via Supportive Pretraining Data
In-context learning (ICL) improves language models' performance on a var...
research
∙
06/20/2023
Open-Domain Text Evaluation via Meta Distribution Modeling
Recent advances in open-domain text generation models powered by large p...
research
∙
05/24/2023
Gender Biases in Automatic Evaluation Metrics: A Case Study on Image Captioning
Pretrained model-based evaluation metrics have demonstrated strong perfo...
research
∙
05/22/2023
Look-back Decoding for Open-Ended Text Generation
Given a prefix (context), open-ended generation aims to decode texts tha...
research
∙
05/19/2023
OPT-R: Exploring the Role of Explanations in Finetuning and Prompting for Reasoning Skills of Large Language Models
In this paper, we conduct a thorough investigation into the reasoning ca...
research
∙
05/10/2023
RECKONING: Reasoning through Dynamic Knowledge Encoding
Recent studies on transformer-based language models show that they can a...
research
∙
05/09/2023
Large Language Model Programs
In recent years, large pre-trained language models (LLMs) have demonstra...
research
∙
02/15/2023
Augmented Language Models: a Survey
This survey reviews works in which language models (LMs) are augmented w...
research
∙
12/24/2022
STRUDEL: Structured Dialogue Summarization for Dialogue Comprehension
Abstractive dialogue summarization has long been viewed as an important ...
research
∙
12/22/2022
OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalization
Recent work has shown that fine-tuning large pre-trained language models...
research
∙
12/19/2022
Improving Faithfulness of Abstractive Summarization by Controlling Confounding Effect of Irrelevant Sentences
Lack of factual correctness is an issue that still plagues state-of-the-...
research
∙
12/16/2022
MURMUR: Modular Multi-Step Reasoning for Semi-Structured Data-to-Text Generation
Prompting large language models has enabled significant recent progress ...
research
∙
12/16/2022
ALERT: Adapting Language Models to Reasoning Tasks
Current large language models can perform reasonably well on complex tas...
research
∙
12/15/2022
ROSCOE: A Suite of Metrics for Scoring Step-by-Step Reasoning
Large language models show improved downstream task performance when pro...
research
∙
11/25/2022
Complementary Explanations for Effective In-Context Learning
Large language models (LLMs) have exhibited remarkable capabilities in l...
research
∙
11/15/2022
ED-FAITH: Evaluating Dialogue Summarization on Faithfulness
Abstractive summarization models typically generate content unfaithful t...
research
∙
08/11/2022
Structural Biases for Improving Transformers on Translation into Morphologically Rich Languages
Machine translation has seen rapid progress with the advent of Transform...
research
∙
05/25/2022
ToKen: Task Decomposition and Knowledge Infusion for Few-Shot Hate Speech Detection
Hate speech detection is complex; it relies on commonsense reasoning, kn...
research
∙
04/12/2022
A Review on Language Models as Knowledge Bases
Recently, there has been a surge of interest in the NLP community on the...
research
∙
12/16/2021
CONFIT: Toward Faithful Dialogue Summarization with Linguistically-Informed Contrastive Fine-tuning
Factual inconsistencies in generated summaries severely limit the practi...
research
∙
12/15/2021
CheckDST: Measuring Real-World Generalization of Dialogue State Tracking Performance
Recent neural models that extend the pretrain-then-finetune paradigm con...
research
∙
12/10/2021
Discourse-Aware Prompt Design for Text Generation
Current efficient fine-tuning methods (e.g., adapters, prefix-tuning, et...
research
∙
11/26/2021
Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs
Do language models have beliefs about the world? Dennett (1995) famously...
research
∙
11/18/2021
How much do language models copy from their training data? Evaluating linguistic novelty in text generation using RAVEN
Current language models can generate high-quality text. Are they simply ...
research
∙
07/30/2021
EmailSum: Abstractive Email Thread Summarization
Recent years have brought about an interest in the challenging task of s...
research
∙
06/02/2021
Enriching Transformers with Structured Tensor-Product Representations for Abstractive Summarization
Abstractive summarization, the task of generating a concise summary of i...
research
∙
03/02/2021
Data Augmentation for Abstractive Query-Focused Multi-Document Summarization
The progress in Query-focused Multi-Document Summarization (QMDS) has be...
research
∙
11/18/2020
Neuro-Symbolic Representations for Video Captioning: A Case for Leveraging Inductive Biases for Vision and Language
Neuro-symbolic representations have proved effective in learning structu...
research
∙
10/24/2020
Go Figure! A Meta Evaluation of Factuality in Summarization
Text generation models can generate factually inconsistent text containi...
research
∙
10/16/2020
Substance over Style: Document-Level Targeted Content Transfer
Existing language models excel at writing from scratch, but many real-wo...
research
∙
06/26/2020
Evaluation of Text Generation: A Survey
The paper surveys evaluation methods of natural language generation (NLG...
research
∙
06/18/2020
Reparameterized Variational Divergence Minimization for Stable Imitation
While recent state-of-the-art results for adversarial imitation-learning...
research
∙
05/19/2020
A Recipe for Creating Multimodal Aligned Datasets for Sequential Tasks
Many high-level procedural tasks can be decomposed into sequences of ins...
research
∙
05/02/2020
RMM: A Recursive Mental Model for Dialog Navigation
Fluent communication requires understanding your audience. In the new co...
research
∙
04/30/2020
PlotMachines: Outline-Conditioned Generation with Dynamic Plot State Tracking
We propose the task of outline-conditioned story generation: given an ou...
research
∙
04/13/2020
AREDSUM: Adaptive Redundancy-Aware Iterative Sentence Ranking for Extractive Document Summarization
Redundancy-aware extractive summarization systems score the redundancy o...
research
∙
11/17/2019
Working Memory Graphs
Transformers have increasingly outperformed gated RNNs in obtaining new ...
research
∙
11/08/2019
Unsupervised Common Question Generation from Multiple Documents using Reinforced Contrastive Coordinator
Web search engines today return a ranked list of document links in respo...
research
∙
09/05/2019
Robust Navigation with Language Pretraining and Stochastic Sampling
Core to the vision-and-language navigation (VLN) challenge is building r...
research
∙
07/02/2019
Cooperative Generator-Discriminator Networks for Abstractive Summarization with Narrative Flow
We introduce Cooperative Generator-Discriminator Networks (Co-opNet), a ...
research
∙
06/19/2019
Learning Compressed Sentence Representations for On-Device Text Processing
Vector representations of sentences, trained on massive text corpora, ar...
research
∙
06/12/2019
COMET: Commonsense Transformers for Automatic Knowledge Graph Construction
We present the first comprehensive study on automatic knowledge base con...
research
∙
06/01/2019
Efficient Adaptation of Pretrained Transformers for Abstractive Summarization
Large-scale learning of transformer language models has yielded improvem...
research
∙
03/25/2019
Cyclical Annealing Schedule: A Simple Approach to Mitigating KL Vanishing
Variational autoencoders (VAEs) with an auto-regressive decoder have bee...
research
∙
02/01/2019
Towards Generating Long and Coherent Text with Multi-Level Latent Variable Models
Variational autoencoders (VAEs) have received much attention recently as...
research
∙
11/25/2018
Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation
Vision-language navigation (VLN) is the task of navigating an embodied a...
research
∙
05/21/2018