arXiv:2411.06333math.OCcs.LG2024-11被引 1

提出可学习的交替优化算法,用于解决非凸非光滑问题。

A Learned Proximal Alternating Minimization Algorithm and Its Induced Network for a Class of Two-block Nonconvex and Nonsmooth Optimization

  • 用自适应平滑技术处理非光滑性,结合残差网络结构提升优化效率。
  • 算法迭代序列存在收敛子列,极限点为Clarke驻点,理论保证可靠。
  • 适用于多模态MRI重建等任务,参数少且性能优于主流方法。

本文提出一种通用的可学习邻近交替最小化算法(LPAM),用于求解可学习的两块非凸非光滑优化问题。通过适当的平滑技术处理非光滑性,实现自动递减的平滑效应;针对平滑后的非凸问题,改进了邻近交替线性化最小化(PALM)方案,引入残差学习架构并以块坐标下降(BCD)迭代作为收敛保障。证明了LPAM生成的迭代序列存在至少一个聚点,且每个聚点均为Clarke驻点。该方法应用广泛,可扩展至多块非凸非光滑优化问题。基于LPAM构建的网络结构——LPAM-net,继承算法收敛性质,具备可解释性。以联合多模态MRI重建为例,实验表明在严重欠采样k空间数据下,LPAM-net具有参数高效、性能优越的特点,优于部分先进方法。

原文摘要 · Abstract (English)

This work proposes a general learned proximal alternating minimization algorithm, LPAM, for solving learnable two-block nonsmooth and nonconvex optimization problems. We tackle the nonsmoothness by an appropriate smoothing technique with automatic diminishing smoothing effect. For smoothed nonconvex problems we modify the proximal alternating linearized minimization (PALM) scheme by incorporating the residual learning architecture, which has proven to be highly effective in deep network training, and employing the block coordinate decent (BCD) iterates as a safeguard for the convergence of the algorithm. We prove that there is a subsequence of the iterates generated by LPAM, which has at least one accumulation point and each accumulation point is a Clarke stationary point. Our method is widely applicable as one can employ various learning problems formulated as two-block optimizations, and is also easy to be extended for solving multi-block nonsmooth and nonconvex optimization problems. The network, whose architecture follows the LPAM exactly, namely LPAM-net, inherits the convergence properties of the algorithm to make the network interpretable. As an example application of LPAM-net, we present the numerical and theoretical results on the application of LPAM-net for joint multi-modal MRI reconstruction with significantly under-sampled k-space data. The experimental results indicate the proposed LPAM-net is parameter-efficient and has favourable performance in comparison with some state-of-the-art methods.

优化算法深度学习MRI重建可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。