research
∙
06/25/2022
Protoformer: Embedding Prototypes for Transformers
Transformers have been widely applied in text classification. Unfortunat...
share
research
∙
03/16/2022
FormNet: Structural Encoding beyond Sequential Modeling in Form Document Information Extraction
Sequence modeling has demonstrated state-of-the-art performance on natur...
research
∙
10/05/2020
Pruning Redundant Mappings in Transformer Models via Spectral-Normalized Identity Prior
Traditional (unstructured) pruning methods for a Transformer model focus...
research
∙
03/29/2018
Universal Sentence Encoder
We present models for encoding sentences into embedding vectors that spe...
research
∙
12/13/2017