research
∙
02/17/2023
False perspectives on human language: why statistics needs linguistics
A sharp tension exists about the nature of human language between two op...
share
research
∙
01/26/2023
How poor is the stimulus? Evaluating hierarchical generalization in neural networks trained on child-directed speech
When acquiring syntax, children consistently choose hierarchical rules o...
research
∙
04/13/2022
Formal Language Recognition by Hard Attention Transformers: Perspectives from Circuit Complexity
This paper analyzes three formal models of Transformer encoders that dif...
research
∙
03/17/2022
Coloring the Blank Slate: Pre-training Imparts a Hierarchical Inductive Bias to Sequence-to-sequence Models
Relations between words are governed by hierarchical structure rather th...
research
∙
02/08/2022
Do Language Models Learn Position-Role Mappings?
How is knowledge of position-role mappings in natural language learned? ...
research
∙
09/24/2021
Transformers Generalize Linearly
Natural language exhibits patterns of hierarchically governed dependenci...
research
∙
11/02/2020
Sequence-to-Sequence Networks Learn the Meaning of Reflexive Anaphora
Reflexive anaphora present a challenge for semantic interpretation: thei...
research
∙
09/08/2020
Probabilistic Predictions of People Perusing: Evaluating Metrics of Language Model Performance for Psycholinguistic Modeling
By positing a relationship between naturalistic reading times and inform...
research
∙
01/10/2020
Does syntax need to grow on trees? Sources of hierarchical inductive bias in sequence-to-sequence networks
Learners that are exposed to the same training data might generalize dif...
research
∙
06/04/2019
Open Sesame: Getting Inside BERT's Linguistic Knowledge
How and to what extent does BERT encode syntactically-sensitive hierarch...
research
∙
06/04/2019
Detecting Syntactic Change Using a Neural Part-of-Speech Tagger
We train a diachronic long short-term memory (LSTM) part-of-speech tagge...
research
∙
06/04/2019
Finding Syntactic Representations in Neural Stacks
Neural network architectures have been augmented with differentiable sta...
research
∙
03/12/2019
Syntax-aware Neural Semantic Role Labeling with Supertags
We introduce a new syntax-aware model for dependency-based semantic role...
research
∙
09/08/2018
Context-Free Transductions with Neural Stacks
This paper analyzes the behavior of stack-augmented recurrent neural net...
research
∙
04/18/2018
End-to-end Graph-based TAG Parsing with Neural Networks
We present a graph-based Tree Adjoining Grammar (TAG) parser that uses B...
research
∙
02/25/2018