research
∙
09/15/2023
Structural Self-Supervised Objectives for Transformers
This thesis focuses on improving the pre-training of natural language mo...
share
research
∙
05/24/2023
Context-Aware Transformer Pre-Training for Answer Sentence Selection
Answer Sentence Selection (AS2) is a core component for building an accu...
research
∙
10/24/2022
Effective Pre-Training Objectives for Transformer-based Autoencoders
In this paper, we study trade-offs between efficiency, cost and accuracy...
research
∙
05/20/2022
Pre-training Transformer Models with Sentence-Level Objectives for Answer Sentence Selection
An important task for designing QA systems is answer sentence selection ...
research
∙
05/02/2022
Paragraph-based Transformer Pre-training for Multi-Sentence Inference
Inference tasks such as answer sentence selection (AS2) or fact verifica...
research
∙
04/20/2021
Efficient pre-training objectives for Transformers
The Transformer architecture deeply changed the natural language process...
research
∙
07/26/2020