This is a Python package for studyding low-dimnesional sufficient statistics of two-layer neural network.
This is a work in progress and unfortunately there is no documentation, but feel free to contact me with any questions.
- Luca Arnaboldi, Florent Krzakala, Bruno Loureiro, Ludovic Stephan Escaping mediocrity: how two-layer networks learn hard single-index models with SGD, 2023 https://arxiv.org/abs/2305.18502.
- Luca Arnaboldi, Ludovic Stephan, Florent Krzakala, Bruno Loureiro From high-dimensional & mean-field dynamics to dimensionless ODEs: A unifying approach to SGD in two-layers networks, 2023 https://arxiv.org/abs/2305.18502.