research
∙
07/13/2023
Generating Benchmarks for Factuality Evaluation of Language Models
Before deploying a language model (LM) within a given domain, it is impo...
share
research
∙
01/31/2023
In-Context Retrieval-Augmented Language Models
Retrieval-Augmented Language Modeling (RALM) methods, that condition a l...
research
∙
12/21/2022
Parallel Context Windows Improve In-Context Learning of Large Language Models
For applications that require processing large amounts of text at infere...
research
∙
12/20/2022
What Are You Token About? Dense Retrieval as Distributions Over the Vocabulary
Dual encoders are now the dominant architecture for dense retrieval. Yet...
research
∙
03/30/2022
Transformer Language Models without Positional Encodings Still Learn Positional Information
Transformers typically require some form of positional encoding, such as...
research
∙
12/14/2021
Learning to Retrieve Passages without Supervision
Dense retrievers for open-domain question answering (ODQA) have been sho...
research
∙
08/12/2021
How Optimal is Greedy Decoding for Extractive Question Answering?
Fine-tuned language models use greedy decoding to answer reading compreh...
research
∙
01/02/2021
Few-Shot Question Answering by Pretraining Span Selection
In a number of question answering (QA) benchmarks, pretrained models hav...
research
∙
01/02/2021
Coreference Resolution without Span Representations
Since the introduction of deep pretrained language models, most task-spe...
research
∙
02/25/2019