Gradients flow back from the loss, multiplied edge by edge.
Loss
The backward pass multiplies local derivatives from the loss back to every parameter. Each node shows its forward value below and its gradient ∂L/∂node above in purple; the amber nodes are the parameters. Drag x below 0.33 and z turns negative: relu passes back zero, so w1 and b1 get no gradient.