research
∙
05/18/2023
LIMA: Less Is More for Alignment
Large language models are trained in two stages: (1) unsupervised pretra...
share
research
∙
05/12/2023
MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers
Autoregressive transformers are spectacular models for short sequences b...
research
∙
05/04/2023
VideoOFA: Two-Stage Pre-Training for Video-to-Text Generation
We propose a new two-stage pre-training framework for video-to-text gene...
research
∙
01/10/2023
Scaling Laws for Generative Mixed-Modal Language Models
Generative language models define distributions over sequences of tokens...
research
∙
12/19/2022
Improving Faithfulness of Abstractive Summarization by Controlling Confounding Effect of Irrelevant Sentences
Lack of factual correctness is an issue that still plagues state-of-the-...
research
∙
04/08/2021
Nutribullets Hybrid: Multi-document Health Summarization
We present a method for generating comparative summaries that highlights...
research
∙
03/22/2021
Nutri-bullets: Summarizing Health Studies by Composing Segments
We introduce Nutri-bullets, a multi-document summarization task for heal...
research
∙
05/27/2020
Rationalizing Text Matching: Learning Sparse Alignments via Optimal Transport
Selecting input features of top relevance has become a popular method fo...
research
∙
11/09/2019
Interactive Classification by Asking Informative Questions
Natural language systems often rely on a single, potentially ambiguous i...
research
∙
06/07/2019