CMU 10-414/714: Deep Learning Systems
Notes from CMU 10-414/714 Deep Learning Systems, focused on the systems and mathematical foundations needed to build deep learning workloads.
Lecture 2: ML Refresher / Softmax Regression Hypothesis classes, loss functions, optimization, softmax regression, cross-entropy, gradient descent, SGD, and the softmax gradient.