research
∙
04/19/2023
Scaling Transformer to 1M tokens and beyond with RMT
This technical report presents the application of a recurrent memory to ...
share
research
∙
07/14/2022
Recurrent Memory Transformer
Transformer-based models show their effectiveness across multiple domain...
research
∙
05/04/2022
Knowledge Distillation of Russian Language Models with Reduction of Vocabulary
Today, transformer language models serve as a core component for majorit...
research
∙
02/05/2020
Goal-Oriented Multi-Task BERT-Based Dialogue State Tracker
Dialogue State Tracking (DST) is a core component of virtual assistants ...
research
∙
05/17/2019