research
∙
06/15/2023
Inverse Scaling: When Bigger Isn't Better
Work on scaling laws has found that large language models (LMs) show pre...
share
research
∙
06/13/2023
BoardgameQA: A Dataset for Natural Language Reasoning with Contradictory Information
Automated reasoning with unstructured natural text is a key requirement ...
research
∙
05/03/2023
Entity Tracking in Language Models
Keeping track of how states and relations of entities change as a text o...
research
∙
12/21/2022
Reconstruction Probing
We propose reconstruction probing, a new analysis method for contextuali...
research
∙
12/21/2022
Uncontrolled Lexical Exposure Leads to Overestimation of Compositional Generalization in Pretrained Models
Human linguistic capacity is often characterized by compositionality and...
research
∙
12/20/2022
LAMBADA: Backward Chaining for Automated Reasoning in Natural Language
Remarkable progress has been made on automated reasoning with knowledge ...
research
∙
12/20/2022
(QA)^2: Question Answering with Questionable Assumptions
Naturally-occurring information-seeking questions often contain question...
research
∙
01/02/2021
Which Linguist Invented the Lightbulb? Presupposition Verification for Question-Answering
Many Question-Answering (QA) datasets contain unanswerable questions, bu...
research
∙
10/12/2020
COGS: A Compositional Generalization Challenge Based on Semantic Interpretation
Natural language is characterized by compositionality: the meaning of a ...
research
∙
05/15/2019
What do you learn from context? Probing for sentence structure in contextualized word representations
Contextualized representation models such as ELMo (Peters et al., 2018a)...
research
∙
04/25/2019
Probing What Different NLP Tasks Teach Machines about Function Word Comprehension
We introduce a set of nine challenge tasks that test for the understandi...
research
∙
12/28/2018
Looking for ELMo's friends: Sentence-Level Pretraining Beyond Language Modeling
Work on the problem of contextualized word representation -- the develop...
research
∙
09/20/2018