research
∙
12/22/2022
OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalization
Recent work has shown that fine-tuning large pre-trained language models...
share
research
∙
04/09/2018
Large scale distributed neural network training through online distillation
Techniques such as ensembling and distillation promise model quality imp...
research
∙
01/23/2017
Regularizing Neural Networks by Penalizing Confident Output Distributions
We systematically explore regularizing neural networks by penalizing low...
research
∙
10/05/2015