Gradient descent
What does Gradient descent mean?
An optimization method that updates parameters in a direction that reduces an objective locally.
A practical example
Repeated weight updates gradually reduce training loss.
MICHAEL ORACLE’S AI DICTIONARY
Training & models · Advanced