Hello guys,
In semi-gradient, when we take the gradient w.r.t. w, why don't we have a "-" sign next to it? Do you think it is a type? Because, when we do an update on w, then we would not have a "-" sign, as we are doing a gradient descent, but on the gradient of error, I think we should have the "-" sign.
Hello,
Yes computing simply the derivative would include a minus sign. But as you said, it will cancel out when we apply gradient descent for the weights. You can find all the details of the computation in the Blackboard of week 5.
Suivre les pulsations de l'EPFL sur les réseaux sociaux
© 2023 EPFL, tous droits réservés