Add momentum to your loop and compare loss curves; read what Adam adds.
Concepts: Maths: momentum, adaptive learning rates (intuition)
Notes, key code, what to skip and 1 curated resources are inside the platform.Join the waitlist and we'll build you a roadmap that includes this topic only if your goal needs it.