research
∙
04/22/2023
On Accelerating Diffusion-Based Sampling Process via Improved Integration Approximation
One popular diffusion-based sampling strategy attempts to solve the reve...
share
research
∙
04/22/2023
Lookahead Diffusion Probabilistic Models for Refining Mean Estimation
We propose lookahead diffusion probabilistic models (LA-DPMs) to exploit...
research
∙
02/02/2023
On Suppressing Range of Adaptive Stepsizes of Adam to Improve Generalisation Performance
A number of recent adaptive optimizers improve the generalisation perfor...
research
∙
03/24/2022
On Exploiting Layerwise Gradient Statistics for Effective Training of Deep Neural Networks
Adam and AdaBelief compute and make use of elementwise adaptive stepsize...
research
∙
12/09/2021
Extending AdamW by Leveraging Its Second Moment and Magnitude
Recent work [4] analyses the local convergence of Adam in a neighbourhoo...
research
∙
10/05/2021
Coarsening Optimization for Differentiable Programming
This paper presents a novel optimization for differentiable programming ...
research
∙
07/19/2021
Revisiting the Primal-Dual Method of Multipliers for Optimisation over Centralised Networks
The primal-dual method of multipliers (PDMM) was originally designed for...
research
∙
11/17/2020
DS-UI: Dual-Supervised Mixture of Gaussian Mixture Models for Uncertainty Inference
This paper proposes a dual-supervised uncertainty inference (DS-UI) fram...
research
∙
10/11/2020
Advanced Dropout: A Model-free Methodology for Bayesian Dropout Optimization
Due to lack of data, overfitting ubiquitously exists in real-world appli...
research
∙
03/10/2020
Channel Attention with Embedding Gaussian Process: A Probabilistic Methodology
Channel attention mechanisms, as the key components of some modern convo...
research
∙
11/21/2019
Approximated Orthonormal Normalisation in Training Neural Networks
Generalisation of a deep neural network (DNN) is one major concern when ...
research
∙
02/24/2019
Rapidly Adapting Moment Estimation
Adaptive gradient methods such as Adam have been shown to be very effect...
research
∙
02/04/2019
Object Detection and 3D Estimation via an FMCW Radar Using a Fully Convolutional Network
This paper considers object detection and 3D estimation using an FMCW ra...
research
∙
07/08/2018