research
∙
05/23/2022
StreamingQA: A Benchmark for Adaptation to New Knowledge over Time in Question Answering Models
Knowledge and language understanding of models evaluated through questio...
share
research
∙
02/08/2022
Competition-Level Code Generation with AlphaCode
Programming is a powerful and ubiquitous problem-solving tool. Developin...
research
∙
10/31/2021
A Systematic Investigation of Commonsense Understanding in Large Language Models
Large language models have shown impressive performance on many natural ...
research
∙
02/04/2021
Adaptive Semiparametric Language Models
We present a language model that combines a large parametric neural netw...
research
∙
02/03/2021
Pitfalls of Static Language Modelling
Our world is open-ended, non-stationary and constantly evolving; thus wh...
research
∙
10/18/2019
A Mutual Information Maximization Perspective of Language Representation Learning
We show state-of-the-art word representation learning methods maximize a...
research
∙
06/03/2019
Episodic Memory in Lifelong Language Learning
We introduce a lifelong language learning setup where a model needs to l...
research
∙
05/23/2019
Training language GANs from Scratch
Generative Adversarial Networks (GANs) enjoy great success at image gene...
research
∙
01/31/2019
Learning and Evaluating General Linguistic Intelligence
We define general linguistic intelligence as the ability to reuse previo...
research
∙
11/26/2018
Sentence Encoding with Tree-constrained Relation Networks
The meaning of a sentence is a function of the relations that hold betwe...
research
∙
01/24/2018