research
∙
09/09/2023
Embedding structure matters: Comparing methods to adapt multilingual vocabularies to new languages
Pre-trained multilingual language models underpin a large portion of mod...
share
research
∙
09/02/2023
Evaluating Transformer's Ability to Learn Mildly Context-Sensitive Languages
Despite that Transformers perform well in NLP tasks, recent studies sugg...
research
∙
05/16/2023
The Weighted Möbius Score: A Unified Framework for Feature Attribution
Feature attribution aims to explain the reasoning behind a black-box mod...
research
∙
09/11/2022
Probing for Understanding of English Verb Classes and Alternations in Large Pre-trained Language Models
We investigate the extent to which verb alternation classes, as describe...
research
∙
09/11/2022
Testing Pre-trained Language Models' Understanding of Distributivity via Causal Mediation Analysis
To what extent do pre-trained language models grasp semantic knowledge r...
research
∙
07/14/2022
Learning to translate by learning to communicate
We formulate and test a technique to use Emergent Communication (EC) wit...
research
∙
05/28/2021
Language Models Use Monotonicity to Assess NPI Licensing
We investigate the semantic knowledge of language models (LMs), focusing...
research
∙
04/17/2021
A multilabel approach to morphosyntactic probing
We introduce a multilabel probing task to assess the morphosyntactic rep...
research
∙
04/16/2021
A Masked Segmental Language Model for Unsupervised Natural Language Segmentation
Segmentation remains an important preprocessing step both in languages w...
research
∙
04/15/2021
Bilingual alignment transfers to multilingual alignment for unsupervised parallel text mining
This work presents methods for learning cross-lingual sentence represent...
research
∙
12/07/2020
Learning Compositional Negation in Populations of Roth-Erev and Neural Agents
Agent-based models and signalling games are useful tools with which to s...
research
∙
10/16/2020
Linguistically-Informed Transformations (LIT): A Method forAutomatically Generating Contrast Sets
Although large-scale pretrained language models, such as BERT and RoBERT...
research
∙
04/30/2020
On the Spontaneous Emergence of Discrete and Compositional Signals
We propose a general framework to study language emergence through signa...
research
∙
09/24/2019
Paying Attention to Function Words
All natural languages exhibit a distinction between content words (like ...
research
∙
04/04/2019
Neural Models of the Psychosemantics of `Most'
How are the meanings of linguistic expressions related to their use in c...
research
∙
06/01/2018