1. Questions and aims of this lecture (6 min)2. Loss Landscape: minima and saddle points (14 min)3. Why are there so many saddle points? (28 min)4. Momentum (15 min)5. RMSprop and ADAM (21 min)6. No Free Lunch theorem (8 min)7. Deep networks versus shallow networks (9 min)
Follow the pulses of EPFL on social networks
© 2023 EPFL, all rights reserved
