research
∙
07/18/2023
Llama 2: Open Foundation and Fine-Tuned Chat Models
In this work, we develop and release Llama 2, a collection of pretrained...
share
research
∙
05/18/2023
LIMA: Less Is More for Alignment
Large language models are trained in two stages: (1) unsupervised pretra...
research
∙
05/06/2023
Residual Prompt Tuning: Improving Prompt Tuning with Residual Reparameterization
Prompt tuning is one of the successful approaches for parameter-efficien...
research
∙
02/04/2023
Representation Deficiency in Masked Language Modeling
Masked Language Modeling (MLM) has been one of the most prominent approa...
research
∙
01/29/2023
Progressive Prompts: Continual Learning for Language Models
We introduce Progressive Prompts - a simple and efficient approach for c...
research
∙
01/25/2023
XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language Models
Large multilingual language models typically rely on a single vocabulary...
research
∙
05/12/2022
CiteSum: Citation Text-guided Scientific Extreme Summarization and Low-resource Domain Adaptation
Scientific extreme summarization (TLDR) aims to form ultra-short summari...
research
∙
10/14/2021
UniPELT: A Unified Framework for Parameter-Efficient Language Model Tuning
Conventional fine-tuning of pre-trained language models tunes all model ...
research
∙
04/18/2021
Extract, Denoise, and Enforce: Evaluating and Predicting Lexical Constraints for Conditional Text Generation
Recently, pre-trained language models (PLMs) have dominated conditional ...
research
∙
01/01/2021
Reader-Guided Passage Reranking for Open-Domain Question Answering
Current open-domain question answering (QA) systems often follow a Retri...
research
∙
10/24/2020
Constrained Abstractive Summarization: Preserving Factual Consistency with Constrained Generation
Summaries generated by abstractive summarization are supposed to only co...
research
∙
09/30/2020
Multi-document Summarization with Maximal Marginal Relevance-guided Reinforcement Learning
While neural sequence learning methods have made significant progress in...
research
∙
09/17/2020
Generation-Augmented Retrieval for Open-domain Question Answering
Conventional sparse retrieval methods such as TF-IDF and BM25 are simple...
research
∙
06/24/2020
AutoKnow: Self-Driving Knowledge Collection for Products of Thousands of Types
Can one build a knowledge graph (KG) for all products in the world? Know...
research
∙
06/18/2020
Octet: Online Catalog Taxonomy Enrichment with Self-Supervision
Taxonomies have found wide applications in various domains, especially o...
research
∙
05/01/2020
Learning Collaborative Agents with Rule Guidance for Knowledge Graph Reasoning
Walk-based models have shown their unique advantages in knowledge graph ...
research
∙
01/26/2020
Generating Representative Headlines for News Stories
of news articles are published online every day, which can be overwhelm...
research
∙
08/27/2019
Hierarchical Text Classification with Reinforced Label Assignment
While existing hierarchical text classification (HTC) methods attempt to...
research
∙
08/27/2019
Facet-Aware Evaluation for Extractive Text Summarization
Commonly adopted metrics for extractive text summarization like ROUGE fo...
research
∙
05/10/2018