Cutting plane methods can be extended into nonconvex optimization

05/22/2018
by   Oliver Hinder, et al.
0

We show that it is possible to obtain an O(ϵ^-4/3) runtime --- including computational cost --- for finding ϵ-stationary points of nonconvex functions using cutting plane methods. This improves on the best known epsilon dependence achieved by cubic regularized Newton of O(ϵ^-3/2) as proved by Nesterov and Polyak (2006)nesterov2006cubic. Our techniques utilize the convex until proven guilty principle proposed by Carmon, Duchi, Hinder, and Sidford (2017)carmon2017convex.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/02/2019

Efficient Algorithms for Smooth Minimax Optimization

This paper studies first order methods for solving smooth minimax optimi...
research
11/08/2017

Stochastic Cubic Regularization for Fast Nonconvex Optimization

This paper proposes a stochastic variant of a classic algorithm---the cu...
research
07/12/2022

A Newton-CG based barrier method for finding a second-order stationary point of nonconvex conic optimization with complexity guarantees

In this paper we consider finding an approximate second-order stationary...
research
06/25/2023

Regularized methods via cubic subspace minimization for nonconvex optimization

The main computational cost per iteration of adaptive cubic regularizati...
research
04/02/2019

On the convergence of cutting-plane methods for robust optimization with ellipsoidal uncertainty sets

Recent advances in cutting-plane strategies applied to robust optimizati...
research
07/26/2019

A simple Newton method for local nonsmooth optimization

Superlinear convergence has been an elusive goal for black-box nonsmooth...
research
01/31/2020

Convergence rate analysis and improved iterations for numerical radius computation

We analyze existing methods for computing the numerical radius and intro...

Please sign up or login with your details

Forgot password? Click here to reset