research
∙
02/22/2023
Regularised neural networks mimic human insight
Humans sometimes show sudden improvements in task performance that have ...
share
research
∙
07/21/2022
The Neural Race Reduction: Dynamics of Abstraction in Gated Networks
Our theoretical understanding of deep learning has not kept pace with it...
research
∙
06/18/2019
Dynamics of stochastic gradient descent for two-layer neural networks in the teacher-student setup
Deep neural networks achieve stellar generalisation even when they have ...
research
∙
01/25/2019
Generalisation dynamics of online learning in over-parameterised neural networks
Deep neural networks achieve stellar generalisation on a variety of prob...
research
∙
10/23/2018
A mathematical theory of semantic development in deep neural networks
An extensive body of empirical research has revealed remarkable regulari...
research
∙
06/03/2018
Minnorm training: an algorithm for training over-parameterized deep neural networks
In this work, we propose a new training method for finding minimum weigh...
research
∙
06/03/2018
Minnorm training: an algorithm for training overcomplete deep neural networks
In this work, we propose a new training method for finding minimum weigh...
research
∙
03/05/2018
Energy-entropy competition and the effectiveness of stochastic gradient descent in machine learning
Finding parameters that minimise a loss function is at the core of many ...
research
∙
10/10/2017
High-dimensional dynamics of generalization error in neural networks
We perform an average case analysis of the generalization dynamics of la...
research
∙
08/01/2017
Hierarchical Subtask Discovery With Non-Negative Matrix Factorization
Hierarchical reinforcement learning methods offer a powerful means of pl...
research
∙
12/08/2016
Hierarchy through Composition with Linearly Solvable Markov Decision Processes
Hierarchical architectures are critical to the scalability of reinforcem...
research
∙
06/07/2016
Active Long Term Memory Networks
Continual Learning in artificial neural networks suffers from interferen...
research
∙
12/19/2014
Qualitatively characterizing neural network optimization problems
Training neural networks involves solving large-scale non-convex optimiz...
research
∙
12/20/2013