Back to Glossary
Gradient Descent
Data / Training / Evaluation
Iterative method to minimize the loss function.
Gradient Descent is an optimization method that adjusts model parameters in the direction of the steepest descent of the loss.
- Variants: Batch, Stochastic, Mini-batch.
- Parameters: Learning rate controls step size and stability.