research
∙
06/05/2023
Second Language Acquisition of Neural Language Models
With the success of neural language models (LMs), their language acquisi...
share
research
∙
05/29/2023
Transformer Language Models Handle Word Frequency in Prediction Head
Prediction head is a crucial component of Transformer language models. D...
research
∙
02/16/2023
Empirical Investigation of Neural Symbolic Reasoning Strategies
Neural reasoning accuracy improves when generating intermediate reasonin...
research
∙
02/15/2023
Do Deep Neural Networks Capture Compositionality in Arithmetic Reasoning?
Compositionality is a pivotal property of symbolic reasoning. However, h...
research
∙
02/01/2023
Does Vision Accelerate Hierarchical Generalization of Neural Language Learners?
Neural language models (LMs) are arguably less data-efficient than human...
research
∙
02/01/2023
Feed-Forward Blocks Control Contextualization in Masked Language Models
Understanding the inner workings of neural network models is a crucial s...
research
∙
05/23/2022
Context Limitations Make Neural Language Models More Human-Like
Do modern natural language processing (NLP) models exhibit human-like la...
research
∙
09/28/2021
Instance-Based Neural Dependency Parsing
Interpretable rationales for model predictions are crucial in practical ...
research
∙
09/15/2021
Incorporating Residual and Normalization Layers into Analysis of Masked Language Models
Transformer architecture has become ubiquitous in the natural language p...
research
∙
06/02/2021
Lower Perplexity is Not Always Human-Like
In computational psycholinguistics, various language models have been ev...
research
∙
11/03/2020
Modeling Event Salience in Narratives via Barthes' Cardinal Functions
Events in a narrative differ in salience: some are more important to the...
research
∙
10/09/2020
Langsmith: An Interactive Academic Text Revision System
Despite the current diversity and inclusion initiatives in the academic ...
research
∙
05/02/2020
Language Models as an Alternative Evaluator of Word Order Hypotheses: A Case Study in Japanese
We examine a methodology using neural language models (LMs) for analyzin...
research
∙
04/29/2020
Instance-Based Learning of Span Representations: A Case Study through Named Entity Recognition
Interpretable rationales for model predictions play a critical role in p...
research
∙
04/21/2020
Attention Module is Not Only a Weight: Analyzing Transformers with Vector Norms
Because attention modules are core components of Transformer-based model...
research
∙
10/21/2019
Diamonds in the Rough: Generating Fluent Sentences from Early-Stage Drafts for Academic Writing Assistance
The writing process consists of several stages such as drafting, revisin...
research
∙
09/05/2019