research
∙
01/18/2023
Discrete Latent Structure in Neural Networks
Many types of data from fields including natural language processing, co...
share
research
∙
10/19/2022
Two-Turn Debate Doesn't Help Humans Answer Hard Reading Comprehension Questions
The use of language-model-based question-answering systems to aid humans...
research
∙
08/26/2022
What Do NLP Researchers Believe? Results of the NLP Community Metasurvey
We present the results of the NLP Community Metasurvey. Run from May to ...
research
∙
04/11/2022
Single-Turn Debate Does Not Help Humans Answer Hard Reading-Comprehension Questions
Current QA systems can generate reasonable-sounding yet false answers wi...
research
∙
03/12/2022
What Makes Reading Comprehension Questions Difficult?
For a natural language understanding benchmark to be useful in research,...
research
∙
12/16/2021
QuALITY: Question Answering with Long Input Texts, Yes!
To enable building and testing models on long-document comprehension, we...
research
∙
10/15/2021
BBQ: A Hand-Built Bias Benchmark for Question Answering
It is well documented that NLP models learn social biases present in the...
research
∙
06/01/2021
What Ingredients Make for an Effective Crowdsourcing Protocol for Difficult NLU Data Collection Tasks?
Crowdsourcing is widely used to create data for common natural language ...
research
∙
04/15/2021
Does Putting a Linguist in the Loop Improve NLU Data Collection?
Many crowdsourced NLP datasets contain systematic gaps and biases that a...
research
∙
09/30/2020
CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Models
Pretrained language models, especially masked language models (MLMs) hav...
research
∙
07/01/2019
Natural Language Understanding with the Quora Question Pairs Dataset
This paper explores the task Natural Language Understanding (NLU) by loo...
research
∙
05/24/2019
Human vs. Muppet: A Conservative Estimate of Human Performance on the GLUE Benchmark
The GLUE benchmark (Wang et al., 2019b) is a suite of language understan...
research
∙
05/24/2019
Human vs. Muppet: A Conservative Estimate of HumanPerformance on the GLUE Benchmark
The GLUE benchmark (Wang et al., 2019b) is a suite of language understan...
research
∙
05/02/2019
SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems
In the last year, new models and methods for pretraining and transfer le...
research
∙
04/17/2018
ListOps: A Diagnostic Dataset for Latent Tree Learning
Latent tree learning models learn to parse a sentence without syntactic ...
research
∙
07/25/2017
The RepEval 2017 Shared Task: Multi-Genre Natural Language Inference with Sentence Representations
This paper presents the results of the RepEval 2017 Shared Task, which e...
research
∙
04/18/2017