arXiv:2412.17888math.OCcs.AI2024-12被引 2

分析可展开前向后向算法在逆问题中的稳定性,尤其关注输入扰动下的鲁棒性。

Stability Bounds for the Unfolded Forward-Backward Algorithm

  • 通过展开前向后向算法构造神经网络求解线性逆问题
  • 理论证明了对输入扰动的李普希茨稳定性,确保小噪声下结果不发散
  • 首次分析偏置项扰动影响,适合关注模型鲁棒性的研究者

我们研究一种用于求解线性已知退化算子逆问题的神经网络架构,该架构通过展开基于目标函数最小化的前向后向算法构建,目标函数包含数据保真项、Tikhonov型正则项及可能非光滑的凸惩罚项。本文从理论上分析了该反演方法对输入扰动的鲁棒性,确保其满足反问题理论中的连续性和抗小噪声能力,这是深度神经网络对抗性扰动敏感性的关键改进。工作的一个关键创新在于分析了网络偏置项(即观测数据)扰动下的鲁棒性。此外,我们提供了数值实验验证所导出的解析李普希茨界。

原文摘要 · Abstract (English)

We consider a neural network architecture designed to solve inverse problems where the degradation operator is linear and known. This architecture is constructed by unrolling a forward-backward algorithm derived from the minimization of an objective function that combines a data-fidelity term, a Tikhonov-type regularization term, and a potentially nonsmooth convex penalty. The robustness of this inversion method to input perturbations is analyzed theoretically. Ensuring robustness complies with the principles of inverse problem theory, as it ensures both the continuity of the inversion method and the resilience to small noise - a critical property given the known vulnerability of deep neural networks to adversarial perturbations. A key novelty of our work lies in examining the robustness of the proposed network to perturbations in its bias, which represents the observed data in the inverse problem. Additionally, we provide numerical illustrations of the analytical Lipschitz bounds derived in our analysis.

逆问题神经网络鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。