Starting from the work by Barzilai and Borwein, gradient methods have gained a great amount of attention, and efficient low-cost schemes are available nowadays. The acceleration strategies used by these methods are based on the definition of effective steplength updating rules, which capture spectral properties of the Hessian of the objective function. The methods arising from this idea represent effective computational tools, extremely appealing for a variety of large-scale optimization problems arising in applications. In this work we discuss the spectral properties of some recently proposed gradient methods with the aim of providing insight into their computational effectiveness. Numerical experiments supporting and illustrating the theoretical analysis are provided
A note on spectral properties of some gradient methods / di Serafino, Daniela; Ruggiero, Valeria; Toraldo, Gerardo; Zanni, Luca. - 1776:(2016), p. 040003. (Intervento presentato al convegno 2nd International Conference on Numerical Computations: Theory and Algorithms, NUMTA 2016 tenutosi a ita nel 2016) [10.1063/1.4965315].
A note on spectral properties of some gradient methods
di Serafino, Daniela;Toraldo, Gerardo;
2016
Abstract
Starting from the work by Barzilai and Borwein, gradient methods have gained a great amount of attention, and efficient low-cost schemes are available nowadays. The acceleration strategies used by these methods are based on the definition of effective steplength updating rules, which capture spectral properties of the Hessian of the objective function. The methods arising from this idea represent effective computational tools, extremely appealing for a variety of large-scale optimization problems arising in applications. In this work we discuss the spectral properties of some recently proposed gradient methods with the aim of providing insight into their computational effectiveness. Numerical experiments supporting and illustrating the theoretical analysis are providedI documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
