Statistique - Probabilités - Optimisation et Contrôle

Wei Lu (INSA Rouen) "Estimation en ligne de l'inverse du Hessien pour l'optimisation stochastique avec application aux algorithmes stochastiques universels de Newton"

Europe/Paris
Salle René Baire (IMB)

Salle René Baire

IMB

Description

This work addresses second-order stochastic optimization for estimating the minimizer of a convex function written as an expectation. A direct recursive estimation technique for the inverse Hessian matrix using a Robbins-Monro procedure is introduced. This approach enables to drastically reduces computational complexity. Above all, it allows to develop universal stochastic Newton methods and investigate the asymptotic efficiency of the proposed approach.