Hello guys,
In semi-gradient, when we take the gradient w.r.t. w, why don't we have a "-" sign next to it? Do you think it is a type? Because, when we do an update on w, then we would not have a "-" sign, as we are doing a gradient descent, but on the gradient of error, I think we should have the "-" sign.
Hello,
Yes computing simply the derivative would include a minus sign. But as you said, it will cancel out when we apply gradient descent for the weights. You can find all the details of the computation in the Blackboard of week 5.
Follow the pulses of EPFL on social networks
© 2023 EPFL, all rights reserved