Séminaire de Statistique et Optimisation

A Random Matrix Approach to Explicit and Implicit Deep Neural Networks

par Zhenyu Liao (Huazhong University of Science & Technology, Chine)

Europe/Paris
Salle J. Cavailles (132) (1R2)

Salle J. Cavailles (132)

1R2

Description

Deep learning has emerged as the cornerstone of modern machine learning. However, its theoretical understanding remains challenging due to the multi-layer structure, non-linearity, and complex statistical dependencies introduced by optimization. In this talk, I will focus on deep neural network (DNN) models and present a random matrix analysis approach to both explicit and implicit DNNs for high-dimensional Gaussian mixture data. By examining the DNN conjugate and neural tangent kernel matrices, this approach establishes *explicit* connections between explicit and implicit networks, as well as between shallow and deep networks.