research
∙
06/11/2023
GKD: A General Knowledge Distillation Framework for Large-scale Pre-trained Language Model
Currently, the reduction in the parameter scale of large-scale pre-train...
share
research
∙
03/20/2023
Multi-task Transformer with Relation-attention and Type-attention for Named Entity Recognition
Named entity recognition (NER) is an important research problem in natur...
research
∙
01/01/2023
Inflected Forms Are Redundant in Question Generation Models
Neural models with an encoder-decoder framework provide a feasible solut...
research
∙
08/23/2022
CLOWER: A Pre-trained Language Model with Contrastive Learning over Word and Character Representations
Pre-trained Language Models (PLMs) have achieved remarkable performance ...
research
∙
12/08/2021
VIRT: Improving Representation-based Models for Text Matching through Virtual Interaction
With the booming of pre-trained transformers, remarkable progress has be...
research
∙
05/08/2021