Homework 2: Xavier/He initialization and RMS Norm, Features and Taylor Expansions, Adam as signSGD and how it changes what we converge to, Demonstrating why muP is needed, induced norms and why Adam and Shampoo fit into this framework.

Due at: Friday, September 18, 2026 at 10:59 PM