登录 注册

Improved Gradient Complexity for Quasi-Newton Proximal Extragradient Methods via Certified Curvature Reuse

🔗 访问原文
🔗 Access Paper

📝 摘要
Abstract

We study how curvature estimated from gradient differences can accelerate proximal-extragradient quasi-Newton methods. Existing global guarantees for QNPE, A-QNPE, and OL-OQN learn Hessian approximations online and incur dimension dependence through regret bounds. We introduce certified curvature reuse: one finite-difference probe per iteration refreshes a group of Hessian columns, while a path-length certificate controls the error of stale columns and determines the step. Each iteration uses at most three gradient queries and one regularized linear solve (or trust-region step), without a gradient line search or an inner oracle-querying loop. In the convex and strongly convex settings, bisection on stored scalar quantities selects a near-maximal certified stepsize; in the nonconvex setting, a uniform certificate gives an explicit learning rate. With other problem parameters fixed, the convex method attains $O(\min\{k^{-2},dk^{-3}\})$ in a single run, with no logarithmic factor or additive dimension term, matching accelerated gradient descent (AGD) for $k\lesssim d$ and improving on A-QNPE thereafter. In the strongly convex setting with condition number $κ$, a single run matches AGD's $(1-Θ(κ^{-1/2}))^k$ rate for $k\lesssim d\logκ$ and achieves a superlinear upper envelope, eventually scaling as $(1+k^2/B^2)^{-k}$ with $B=\tilde O(dκ)$, improving on QNPE. In the nonconvex setting, the method finds an $\varepsilon$-stationary point in $O(\min\{d^{1/3}\varepsilon^{-3/2},\varepsilon^{-7/4}\})$ gradient queries, improving on OL-OQN's $O(d^{1/4}\varepsilon^{-13/8})$. For sparse Hessians, $d$ is replaced by an effective dimension $χ\le d$. We also compare our bounds with lazy-Hessian, double-loop, and cutting-plane methods.

📊 文章统计
Article Statistics

基础数据
Basic Stats

151 浏览
Views
0 下载
Downloads
3 引用
Citations

引用趋势
Citation Trend

阅读国家分布
Country Distribution

阅读机构分布
Institution Distribution

月度浏览趋势
Monthly Views

相关关键词
Related Keywords

影响因子分析
Impact Analysis

8.20 综合评分
Overall Score
引用影响力
Citation Impact
浏览热度
View Popularity
下载频次
Download Frequency

📄 相关文章
Related Articles

海洋智能分析Ocean AI Analysis

正在分析中,请稍候…Analyzing, please wait…
海洋智能体 🌊
海洋智能体
AI科研助手 · 4376篇文献
我看到你正在阅读一篇文献,需要我帮你解读摘要、推荐相关论文,或者分析研究方法论吗?