research
∙
07/06/2023
Lost in the Middle: How Language Models Use Long Contexts
While recent language models have the ability to take long contexts as i...
share
research
∙
12/07/2022
JamPatoisNLI: A Jamaican Patois Natural Language Inference Dataset
JamPatoisNLI provides the first dataset for natural language inference i...
research
∙
10/27/2022
Truncation Sampling as Language Model Desmoothing
Long samples of text from neural language models can be of poor quality....
research
∙
09/19/2021
Conditional probing: measuring usable information beyond a baseline
Probing experiments investigate the extent to which neural representatio...
research
∙
04/19/2021
Refining Targeted Syntactic Evaluation of Language Models
Targeted syntactic evaluation of subject-verb number agreement in Englis...
research
∙
04/16/2021
Probing artificial neural networks: insights from neuroscience
A major challenge in both neuroscience and machine learning is the devel...
research
∙
10/15/2020
RNNs can generate bounded hierarchical languages with optimal memory
Recurrent neural networks empirically generate natural language with hig...
research
∙
10/14/2020
The EOS Decision and Length Extrapolation
Extrapolation to unseen sequence lengths is a challenge for neural gener...
research
∙
05/09/2020
Finding Universal Grammatical Relations in Multilingual BERT
Recent work has found evidence that Multilingual BERT (mBERT), a transfo...
research
∙
09/08/2019
Designing and Interpreting Probes with Control Tasks
Probes, supervised models trained to predict properties (like parts-of-s...
research
∙
03/19/2019
Simple, Fast, Accurate Intent Classification and Slot Labeling
In real-time dialogue systems running at scale, there is a tradeoff betw...
research
∙
03/01/2018