research
∙
08/19/2023
East: Efficient and Accurate Secure Transformer Framework for Inference
Transformer has been successfully used in practical applications, such a...
share
research
∙
01/09/2023
ERNIE 3.0 Tiny: Frustratingly Simple Method to Improve Task-Agnostic Distillation Generalization
Task-agnostic knowledge distillation attempts to address the problem of ...
research
∙
02/14/2022
Learning Weakly-Supervised Contrastive Representations
We argue that a form of the valuable information provided by the auxilia...
research
∙
12/23/2021
ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generation
Pre-trained language models have achieved state-of-the-art results in va...
research
∙
07/05/2021
ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generation
Pre-trained models have achieved state-of-the-art results in various Nat...
research
∙
06/05/2021
Integrating Auxiliary Information in Self-supervised Learning
This paper presents to integrate the auxiliary information (e.g., additi...
research
∙
06/04/2021