arXiv:2602.04110cs.LG2026-02被引 1

提出最优噪声退火策略,解决半对偶神经最优传输的错误收敛问题。

Rate-Optimal Noise Annealing in Semi-Dual Neural Optimal Transport: Tangential Identifiability, Off-Manifold Ambiguity, and Guaranteed Recovery

  • 通过添加可计算的最优噪声水平,实现统计最优恢复
  • 噪声趋近零时优化条件恶化,低于阈值反致性能下降
  • 适用于低维流形数据的神经最优传输建模

半对偶神经最优传输通过极大极小目标学习传输映射,但训练常收敛至错误或退化的解。在数据集中于低维流形的常见情形下,我们完全刻画了这些虚假解:目标函数在数据流形外欠约束,而流形上运输信号仍可识别。借鉴Choi, Choi, and Kwon (2025) 的加性噪声平滑方法,我们证明了噪声消失时的新映射恢复保证。主要实用贡献是提出一个可计算的终端噪声水平 $varepsilon_{\mathrm{stat}}(N)$,达到最优统计速率,其尺度由数据内在维度 $m$ 决定。该公式源于对(i)最优计划的定量稳定性、(ii)平滑引入的偏差、(iii)有限样本误差的统一理论分析,所得速率依赖于 $m$ 而非环境维数。最后,我们表明当 $varepsilon \downarrow 0$ 时,简化后的半对偶目标愈发病态。这提供了一个原则性停止规则:低于 $varepsilon_{\mathrm{stat}}(N)$ 的退火会恶化优化条件,却无法提升统计精度。

原文摘要 · Abstract (English)

Semi-dual neural optimal transport learns a transport map via a max-min objective, yet training can converge to incorrect or degenerate maps. We fully characterize these spurious solutions in the common regime where data concentrate on low-dimensional manifold: the objective is underconstrained off the data manifold, while the on-manifold transport signal remains identifiable. Following Choi, Choi, and Kwon (2025), we study additive-noise smoothing as a remedy and prove new map recovery guarantees as the noise vanishes. Our main practical contribution is a computable terminal noise level $\varepsilon_{\mathrm{stat}}(N)$ that attains the optimal statistical rate, with scaling governed by the intrinsic dimension $m$ of the data. The formula arises from a theoretical unified analysis of (i) quantitative stability of optimal plans, (ii) smoothing-induced bias, and (iii) finite-sample error, yielding rates that depend on $m$ rather than the ambient dimension. Finally, we show that the reduced semi-dual objective becomes increasingly ill-conditioned as $\varepsilon \downarrow 0$. This provides a principled stopping rule: annealing below $\varepsilon_{\mathrm{stat}}(N)$ can $\textit{worsen}$ optimization conditioning without improving statistical accuracy.

最优传输神经网络噪声退火低维流形

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。