Séminaire Modélisation, Optimisation, Dynamique

First-order methods for the impatient - support identification in finite time with Frank/Wolfe-variants

par Abdel Lisser

Europe/Paris
Salle de conférence (XLIM)

Salle de conférence

XLIM

FST-Université de Limoges 123 Av. Albert Thomas, 87000 Limoges
Description

We study active set identification results for the away-step Frank-Wolfe algorithm in different settings. We first prove a local identification property that we apply, in combination with a convergence hypothesis, to get an active set identification result. We then prove, in the nonconvex case, a novel $O(1/\sqrt{k})$ convergence rate result and active set identification for different step sizes (under suitable assumptions on the set of stationary points). By exploiting those results, we also give explicit active set complexity bounds for both strongly convex and nonconvex objectives. While we initially consider the probability simplex as feasible set, time permitting we show how to adapt some of our results to generic polytopes. A particular case with interesting applications covers projection-free methods on product domains.