research
∙
06/20/2023
Closing the loop: Autonomous experiments enabled by machine-learning-based online data analysis in synchrotron beamline environments
Recently, there has been significant interest in applying machine learni...
share
research
∙
05/26/2023
Tokenization Impacts Multilingual Language Modeling: Assessing Vocabulary Allocation and Overlap Across Languages
Multilingual language models have recently gained attention as a promisi...
research
∙
12/19/2022
Independent Components of Word Embeddings Represent Semantic Features
Independent Component Analysis (ICA) is an algorithm originally develope...
research
∙
06/21/2022
Don't Forget About Pronouns: Removing Gender Bias in Language Models Without Losing Factual Gender Information
The representations in large language models contain multiple types of g...
research
∙
09/10/2021
Examining Cross-lingual Contextual Embeddings with Orthogonal Structural Probes
State-of-the-art contextual embeddings are obtained from large language ...
research
∙
02/17/2021
THEaiTRE 1.0: Interactive generation of theatre play scripts
We present the first version of a system for interactive generation of t...
research
∙
12/30/2020
Introducing Orthogonal Constraint in Structural Probes
With the recent success of pre-trained models in NLP, a significant focu...
research
∙
10/02/2020
Syntax Representation in Word Embeddings and Neural Networks – A Survey
Neural networks trained on natural language processing tasks capture syn...
research
∙
06/29/2020
Measuring Memorization Effect in Word-Level Neural Networks Probing
Multiple studies have probed representations emerging in neural networks...
research
∙
06/25/2020
THEaiTRE: Artificial Intelligence to Write a Theatre Play
We present THEaiTRE, a starting project aimed at automatic generation of...
research
∙
06/27/2019
Inducing Syntactic Trees from BERT Representations
We use the English model of BERT and explore how a deletion of one word ...
research
∙
06/06/2019
Derivational Morphological Relations in Word Embeddings
Derivation is a type of a word-formation process which creates new words...
research
∙
06/05/2019
From Balustrades to Pierre Vinken: Looking for Syntax in Transformer Self-Attentions
We inspect the multi-head self-attention in Transformer NMT encoders for...
research
∙
11/12/2018