I understand in the gradient descent optimisation algorithm , in each iteration we need to take a step opposite to the direction of the gradient.
In the above diagram the direction of the gradient vector is opposite to delta theta? Can somebody please help me understand this?