Your first note is 60 seconds away.
Already have an account? Sign in
By creating an account, you agree to our Terms and acknowledge our Privacy.
Backprop is just the chain rule applied efficiently; ReLU keeps gradients active in deep networks.