提出一种无需维度依赖的鲁棒统计学习方法,适用于高维数据
E-ROBOT: a dimension-free method for robust statistics and machine learning via Schrödinger bridge
- 基于薛定谔桥理论,用参数λ控制鲁棒性、ε控制正则强度
- 样本复杂度达O(n⁻¹/²),突破传统方法的维度灾难限制
- 可直接用于图像颜色迁移、形状计算等高维任务,易实现
我们提出熵正则鲁棒最优传输(E-ROBOT)框架,结合了ROBOT的鲁棒性与熵正则化的计算和统计优势。基于薛定谔桥问题理论,E-ROBOT定义了鲁棒Sinkhorn散度$\overline{W}_{\varepsilon,λ}$,其中参数$λ$控制鲁棒性,$\varepsilon$决定正则强度。核心理论贡献是证明了$\overline{W}_{\varepsilon,λ}$的样本复杂度为$\mathcal{O}(n^{-1/2})$,避免了标准ROBOT面临的维度灾难。这一无维度依赖特性使$\overline{W}_{\varepsilon,λ}$可作为高维统计与机器学习任务的损失函数。我们通过四个应用展示了其有效性:拟合优度检验;受污染2D/3D形状的巴氏中心计算;梯度流定义;图像颜色迁移。从实现角度看,只需修改现有Python代码即可轻松部署。理论上,本工作为统计与机器学习开辟了新方向。
原文摘要 · Abstract (English)
We propose the Entropic-regularized Robust Optimal Transport (E-ROBOT) framework, a novel method that combines the robustness of ROBOT with the computational and statistical benefits of entropic regularization. We show that, rooted in the Schrödinger bridge problem theory, E-ROBOT defines the robust Sinkhorn divergence $\overline{W}_{\varepsilon,λ}$, where the parameter $λ$ controls robustness and $\varepsilon$ governs the regularization strength. Letting $n\in \mathbb{N}$ denote the sample size, a central theoretical contribution is establishing that the sample complexity of $\overline{W}_{\varepsilon,λ}$ is $\mathcal{O}(n^{-1/2})$, thereby avoiding the curse of dimensionality that plagues standard ROBOT. This dimension-free property unlocks the use of $\overline{W}_{\varepsilon,λ}$ as a loss function in large-dimensional statistical and machine learning tasks. With this regard, we demonstrate its utility through four applications: goodness-of-fit testing; computation of barycenters for corrupted 2D and 3D shapes; definition of gradient flows; and image colour transfer. From the computation standpoint, a perk of our novel method is that it can be easily implemented by modifying existing (\texttt{Python}) routines. From the theoretical standpoint, our work opens the door to many research directions in statistics and machine learning: we discuss some of them.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。