research
∙
05/24/2023
Dynamic Masking Rate Schedules for MLM Pretraining
Most works on transformers trained with the Masked Language Modeling (ML...
share
research
∙
06/02/2022
Fast Benchmarking of Accuracy vs. Training Time with Cyclic Learning Rates
Benchmarking the tradeoff between neural network accuracy and training t...
research
∙
06/21/2021
Multiplying Matrices Without Multiplying
Multiplying matrices is among the most fundamental and compute-intensive...
research
∙
05/13/2021
Causally-motivated Shortcut Removal Using Auxiliary Labels
Robustness to certain distribution shifts is a key requirement in many M...
research
∙
11/23/2020
When and Why Test-Time Augmentation Works
Test-time augmentation (TTA)—the aggregation of predictions across trans...
research
∙
03/06/2020
What is the State of Neural Network Pruning?
Neural network pruning—the task of reducing the size of a network by rem...
research
∙
12/02/2018
Multiple Instance Learning for ECG Risk Stratification
In this paper, we apply a multiple instance learning paradigm to signal-...
research
∙
08/07/2018