research
∙
09/11/2023
Uncovering mesa-optimization algorithms in Transformers
Transformers have become the dominant model in deep learning, but the re...
share
research
∙
09/04/2023
Gated recurrent neural networks discover attention
Recent architectural developments have enabled recurrent neural networks...
research
∙
06/29/2023
Would I have gotten that reward? Long-term credit assignment by counterfactual contribution analysis
To make reinforcement learning more sample efficient, we need better cre...
research
∙
10/18/2022
Disentangling the Predictive Variance of Deep Ensembles through the Neural Tangent Kernel
Identifying unfamiliar inputs, also known as out-of-distribution (OOD) d...
research
∙
10/17/2022
Meta-Learning via Classifier(-free) Guidance
State-of-the-art meta-learning techniques do not optimize for zero-shot ...
research
∙
07/04/2022
The least-control principle for learning at equilibrium
Equilibrium systems are a powerful way to express neural computations. A...
research
∙
10/27/2021
Learning where to learn: Gradient sparsity in meta and continual learning
Finding neural network weights that generalize well from small datasets ...
research
∙
03/01/2021
Posterior Meta-Replay for Continual Learning
Continual Learning (CL) algorithms have recently received a lot of atten...
research
∙
07/25/2020