research
∙
06/06/2023
Guiding The Last Layer in Federated Learning with Pre-Trained Models
Federated Learning (FL) is an emerging paradigm that allows a model to b...
share
research
∙
04/11/2023
Re-Weighted Softmax Cross-Entropy to Control Forgetting in Federated Learning
In Federated Learning, a global model is learned by aggregating model up...
research
∙
11/18/2022
Building a Subspace of Policies for Scalable Continual Learning
The ability to continuously acquire new knowledge and skills is crucial ...
research
∙
11/07/2022
Multi-Head Adapter Routing for Data-Efficient Fine-Tuning
Parameter-efficient fine-tuning (PEFT) methods can adapt large language ...
research
∙
03/08/2022
New Insights on Reducing Abrupt Representation Change in Online Continual Learning
In the online continual learning paradigm, agents must learn from a chan...
research
∙
06/17/2021
On Anytime Learning at Macroscale
Classical machine learning frameworks assume access to a possibly large ...
research
∙
06/16/2021
SPeCiaL: Self-Supervised Pretraining for Continual Learning
This paper presents SPeCiaL: a method for unsupervised pretraining of re...
research
∙
06/11/2021
Decoupled Greedy Learning of CNNs for Synchronous and Asynchronous Distributed Learning
A commonly cited inefficiency of neural network training using back-prop...
research
∙
04/11/2021
Reducing Representation Drift in Online Continual Learning
We study the online continual learning paradigm, where agents must learn...
research
∙
03/12/2020
Online Fast Adaptation and Knowledge Accumulation: a New Approach to Continual Learning
Learning from non-stationary data remains a great challenge for machine ...
research
∙
11/19/2019
Online Learned Continual Compression with Stacked Quantization Module
We introduce and study the problem of Online Continual Compression, wher...
research
∙
08/11/2019
Online Continual Learning with Maximally Interfered Retrieval
Continual learning, the setting where a learning agent is faced with a n...
research
∙
05/23/2019
Recurrent Value Functions
Despite recent successes in Reinforcement Learning, value-based methods ...
research
∙
12/04/2018
Deep Generative Modeling of LiDAR Data
Building models capable of generating structured output is a key challen...
research
∙
11/06/2018