research
∙
03/18/2023
SPDF: Sparse Pre-training and Dense Fine-tuning for Large Language Models
The pre-training and fine-tuning paradigm has contributed to a number of...
share
research
∙
06/28/2022
RevBiFPN: The Fully Reversible Bidirectional Feature Pyramid Network
This work introduces the RevSilo, the first reversible module for bidire...
research
∙
05/27/2021
Training With Data Dependent Dynamic Learning Rates
Recently many first and second order variants of SGD have been proposed ...
research
∙
04/19/2021
Memory Efficient 3D U-Net with Reversible Mobile Inverted Bottlenecks for Brain Tumor Segmentation
We propose combining memory saving techniques with traditional U-Net arc...
research
∙
01/07/2020
Stochastic Weight Averaging in Parallel: Large-Batch Training that Generalizes Well
We propose Stochastic Weight Averaging in Parallel (SWAP), an algorithm ...
research
∙
10/03/2014
HD-CNN: Hierarchical Deep Convolutional Neural Network for Large Scale Visual Recognition
In image classification, visual separability between different object ca...
research
∙
04/22/2014
Fast Approximate Matching of Cell-Phone Videos for Robust Background Subtraction
We identify a novel instance of the background subtraction problem that ...
research
∙
12/17/2013