research
∙
09/20/2023
Sequence-to-Sequence Spanish Pre-trained Language Models
In recent years, substantial advancements in pre-trained language models...
share
research
∙
05/12/2023
A Memory Model for Question Answering from Streaming Data Supported by Rehearsal and Anticipation of Coreference Information
Existing question answering methods often assume that the input content ...
research
∙
10/03/2022
How Relevant is Selective Memory Population in Lifelong Language Learning?
Lifelong language learning seeks to have models continuously learn multi...
research
∙
07/04/2022
It's all About Consistency: A Study on Memory Composition for Replay-Based Methods in Continual Learning
Continual Learning methods strive to mitigate Catastrophic Forgetting (C...
research
∙
04/19/2022
ALBETO and DistilBETO: Lightweight Spanish Language Models
In recent years there have been considerable advances in pre-trained lan...
research
∙
04/18/2022
Entropy-based Stability-Plasticity for Lifelong Learning
The ability to continuously learn remains elusive for deep learning mode...
research
∙
09/24/2021
DACT-BERT: Differentiable Adaptive Computation Time for an Efficient BERT Inference
Large-scale pre-trained language models have shown remarkable results in...
research
∙
09/10/2021
Augmenting BERT-style Models with Predictive Coding to Improve Discourse-level Representations
Current language models are usually trained using a self-supervised sche...
research
∙
07/24/2021
Stress Test Evaluation of Biomedical Word Embeddings
The success of pretrained word embeddings has motivated their use in the...
research
∙
06/21/2021
TNT: Text-Conditioned Network with Transductive Inference for Few-Shot Video Classification
Recently, few-shot learning has received increasing interest. Existing e...
research
∙
07/30/2020
Interpretable Contextual Team-aware Item Recommendation: Application in Multiplayer Online Battle Arena Games
The video game industry has adopted recommendation systems to boost user...
research
∙
06/01/2020
Translating Natural Language Instructions for Behavioral Robot Navigation with a Multi-Head Attention Mechanism
We propose a multi-head attention mechanism as a blending layer in a neu...
research
∙
04/23/2020
On Adversarial Examples for Biomedical NLP Tasks
The success of pre-trained word embeddings has motivated its use in task...
research
∙
02/14/2020