research
∙
06/11/2023
ARIST: An Effective API Argument Recommendation Approach
Learning and remembering to use APIs are difficult. Several techniques h...
share
research
∙
10/16/2021
Transformer with a Mixture of Gaussian Keys
Multi-head attention is a driving force behind state-of-the-art transfor...
research
∙
10/10/2021
Heavy Ball Neural Ordinary Differential Equations
We propose heavy ball neural ordinary differential equations (HBNODEs), ...
research
∙
08/05/2021
FMMformer: Efficient and Flexible Transformer via Decomposed Near-field and Far-field Attention
We propose FMMformers, a class of efficient and flexible transformers in...
research
∙
06/12/2020
MomentumRNN: Integrating Momentum into Recurrent Neural Networks
Designing deep neural networks is an art that often involves an expensiv...
research
∙
02/24/2020
Scheduled Restart Momentum for Accelerated Stochastic Gradient Descent
Stochastic gradient descent (SGD) with constant momentum and its variant...
research
∙
12/09/2019