research
∙
06/01/2023
Hierarchical Attention Encoder Decoder
Recent advances in large language models have shown that autoregressive ...
share
research
∙
05/25/2023
Online learning of long-range dependencies
Online learning holds the promise of enabling efficient long-term credit...
research
∙
02/16/2022
Open-Ended Reinforcement Learning with Neural Reward Functions
Inspired by the great success of unsupervised learning in Computer Visio...
research
∙
10/11/2019
Improving Gradient Estimation in Evolutionary Strategies With Past Descent Directions
Evolutionary Strategies (ES) are known to be an effective black-box opti...
research
∙
10/11/2019
Decoupling Hierarchical Recurrent Neural Networks With Locally Computable Losses
Learning long-term dependencies is a key long-standing challenge of recu...
research
∙
02/11/2019
Optimal Kronecker-Sum Approximation of Real Time Recurrent Learning
One of the central goals of Recurrent Neural Networks (RNNs) is to learn...
research
∙
08/16/2018
The linear hidden subset problem for the (1+1) EA with scheduled and adaptive mutation rates
We study unbiased (1+1) evolutionary algorithms on linear functions with...
research
∙
05/28/2018
Approximating Real-Time Recurrent Learning with Random Kronecker Factors
Despite all the impressive advances of recurrent neural networks, sequen...
research
∙
05/24/2017