Topic

Gradient descent

3 concepts and 30 practice problems on gradient descent, part of Continuous optimization.

3concepts
30exercises
≈ 2 hof study approx.

Study this topic →

Concepts

  • Line search 10 exercisesLine search is a procedure that chooses the step size α along a descent direction p_k to reduce the value of the objective functi…
  • Wolfe conditions 10 exercisesTwo inequalities that a line-search step α must satisfy to guarantee sufficient decrease of the function and that the step is not…
  • Convergence with Lipschitz gradient 10 exercisesResult guaranteeing that gradient descent with a suitable step size converges for differentiable functions whose gradient ∇ f is…