Temporary version in debug phase

Lecture 4 - RMS RMS norm, Maximal update parameterization (μP)

September 10th, 2026
  • Local linear perspective (Recap)
  • Sign SGD
  • Gradient Descent
  • Shampoo
  • Towards up and muon.

Back to Top

Accessibility Nondiscrimination

Copyright ©2026, Regents of the University of California and respective authors.

This site is built following the Berkeley Class Site template, which is generously based on the Just the Class, and Just the Docs templates.

View all course offerings