research
∙
06/30/2023
Meta-training with Demonstration Retrieval for Efficient Few-shot Learning
Large language models show impressive results on few-shot NLP tasks. How...
share
research
∙
06/15/2023
Inverse Scaling: When Bigger Isn't Better
Work on scaling laws has found that large language models (LMs) show pre...
research
∙
05/31/2023
How to Plant Trees in Language Models: Data and Architectural Effects on the Emergence of Syntactic Inductive Biases
Accurate syntactic representations are essential for robust generalizati...
research
∙
01/27/2023
Call for Papers – The BabyLM Challenge: Sample-efficient pretraining on a developmentally plausible corpus
We present the call for papers for the BabyLM Challenge: Sample-efficien...
research
∙
12/18/2022
Language model acceptability judgements are not always robust to context
Targeted syntactic evaluations of language models ask whether models sho...
research
∙
10/25/2022
Causal Analysis of Syntactic Agreement Neurons in Multilingual Language Models
Structural probing work has found evidence for latent syntactic informat...
research
∙
08/26/2022
What Do NLP Researchers Believe? Results of the NLP Community Metasurvey
We present the results of the NLP Community Metasurvey. Run from May to ...
research
∙
04/14/2022
Label Semantic Aware Pre-training for Few-shot Text Classification
In text classification tasks, useful information is encoded in the label...
research
∙
03/17/2022
Coloring the Blank Slate: Pre-training Imparts a Hierarchical Inductive Bias to Sequence-to-sequence Models
Relations between words are governed by hierarchical structure rather th...
research
∙
06/10/2021
Causal Analysis of Syntactic Agreement Mechanisms in Neural Language Models
Targeted syntactic evaluations have demonstrated the ability of language...
research
∙
04/11/2021
Fine-tuning Encoders for Improved Monolingual and Zero-shot Polylingual Neural Topic Modeling
Neural topic models can augment or replace bag-of-words inputs with the ...
research
∙
10/14/2020
Decoding Methods for Neural Narrative Generation
Narrative generation is an open-ended NLP task in which a model generate...
research
∙
10/13/2020
Demographic Representation and Collective Storytelling in the Me Too Twitter Hashtag Activism Movement
The #MeToo movement on Twitter has drawn attention to the pervasive natu...
research
∙
05/01/2020
Cross-Linguistic Syntactic Evaluation of Word Prediction Models
A range of studies have concluded that neural word prediction models can...
research
∙
10/03/2019
Modeling Color Terminology Across Thousands of Languages
There is an extensive history of scholarship into what constitutes a "ba...
research
∙
08/31/2019