research
∙
06/22/2023
Quantizable Transformers: Removing Outliers by Helping Attention Heads Do Nothing
Transformer models have been widely adopted in various domains over the ...
share
research
∙
03/21/2022
Overcoming Oscillations in Quantization-Aware Training
When training neural networks with simulated quantization, we observe th...
research
∙
09/27/2021
Understanding and Overcoming the Challenges of Efficient Transformer Quantization
Transformer-based architectures have become the de-facto standard models...
research
∙
06/15/2021