research
∙
09/09/2023
Embedding structure matters: Comparing methods to adapt multilingual vocabularies to new languages
Pre-trained multilingual language models underpin a large portion of mod...
share
research
∙
05/24/2023
BUFFET: Benchmarking Large Language Models for Few-shot Cross-lingual Transfer
Despite remarkable advancements in few-shot generalization in natural la...
research
∙
04/26/2023
Translate to Disambiguate: Zero-shot Multilingual Word Sense Disambiguation with Pretrained Language Models
Pretrained Language Models (PLMs) learn rich cross-lingual knowledge and...
research
∙
12/08/2022
Demystifying Prompts in Language Models via Perplexity Estimation
Language models can be prompted to perform a wide variety of zero- and f...
research
∙
11/15/2022
Prompting Language Models for Linguistic Structure
Although pretrained language models (PLMs) can be prompted to perform a ...
research
∙
05/24/2022
Analyzing the Mono- and Cross-Lingual Pretraining Dynamics of Multilingual Language Models
The emergent cross-lingual transfer seen in multilingual pretrained mode...
research
∙
05/09/2022
Few-shot Mining of Naturally Occurring Inputs and Outputs
Creating labeled natural language training data is expensive and require...
research
∙
04/17/2022
Language Contamination Explains the Cross-lingual Capabilities of English Pretrained Models
English pretrained language models, which make up the backbone of many m...
research
∙
02/16/2021
FEWS: Large-Scale, Low-Shot Word Sense Disambiguation with the Dictionary
Current models for Word Sense Disambiguation (WSD) struggle to disambigu...
research
∙
05/06/2020
Moving Down the Long Tail of Word Sense Disambiguation with Gloss-Informed Biencoders
A major obstacle in Word Sense Disambiguation (WSD) is that word senses ...
research
∙
06/03/2019
Better Character Language Modeling Through Morphology
We incorporate morphological supervision into character language models ...
research
∙
05/11/2018