Exercise · ZW-CONVERGENCE-WITH-LIPSCHITZ-GRADIENT-009 · ★★☆ Intermediate
For \( f(x)=\frac{1}{2}x^2 \) with \( t=1/L \), what is \( x_1 \) if \( x_0=4 \)?
Choose one option.
Show answer
- A. \( 0 \)
Explanation
With \( L=1 \) and \( \nabla f(x_0)=4 \), the step gives \( x_1=4-4=0 \). Writing \( 2 \) corresponds to using \( t=1/2 \) instead of \( 1/L \).
Review the concept: Convergence with Lipschitz gradient
Result guaranteeing that gradient descent with a suitable step size converges for differentiable functions whose gradient \( \nabla f \) is Lipschitz continuous with constant \( L \).
\[f(x_k)-f^* \le \frac{L\|x_0-x^*\|^2}{2k}\]
More practice problems: convergence with lipschitz gradient
- ZW-CONVERGENCE-WITH-LIPSCHITZ-GRADIENT-001 What does it mean for ∇ f to be Lipschitz with constant L ?
- ZW-CONVERGENCE-WITH-LIPSCHITZ-GRADIENT-002 If ∇ f is Lipschitz with constant L , which gradient step is the standard choice?
- ZW-CONVERGENCE-WITH-LIPSCHITZ-GRADIENT-003 What is the function-value convergence rate for convex gradient descent with step 1/L ?
- ZW-CONVERGENCE-WITH-LIPSCHITZ-GRADIENT-004 Which inequality follows from the Lipschitz condition on the gradient?
- ZW-CONVERGENCE-WITH-LIPSCHITZ-GRADIENT-005 If ∇ f is Lipschitz, what does convexity of f add for the descent sequence?
- ZW-CONVERGENCE-WITH-LIPSCHITZ-GRADIENT-006 A function has L=4 . What step t is safe under the rule t=1/L ?
- ZW-CONVERGENCE-WITH-LIPSCHITZ-GRADIENT-007 For f(x)=x^2 on ℝ , what is the Lipschitz constant L of the gradient?
- ZW-CONVERGENCE-WITH-LIPSCHITZ-GRADIENT-008 If ∇ f is Lipschitz with L=3 and \|x_0-x^*\|=2 , what bound does the O(1/k) rate give for k=6 ?
← ZW-CONVERGENCE-WITH-LIPSCHITZ-GRADIENT-008 ZW-CONVERGENCE-WITH-LIPSCHITZ-GRADIENT-010 →