You are right when the gradients are strong. But suppose that the path has to connect two portions of the contour with a gap in between them where the gradient is weak or non-existent, for example due to noise or occlusions. In such a case, we want the straightest possible path and that's what C "brings to the table". As often in vision, it's a compromise.