BACKPROP NINJA PLAYGROUND

INTERACTIVE CALCULUS · LECTURE 6

1. Multiplication Gate (Z = X * W)
X 4
W -2
Forward: Z = -8 | Upstream Gradient (dL/dZ) = 1.0
dL/dX = ?
dL/dW = ?
2. Softmax & Cross-Entropy (p - y)

Target: CAT (Middle Index)

Rule: dL/dZ = Probability - Target