用贝叶斯优化学习投影方向,提升切片水氏距离计算效率。
Efficient Sliced Wasserstein Distance Computation via Adaptive Bayesian Optimization
- 基于贝叶斯优化动态选择最优投影方向
- 新方法在保持精度的同时降低计算开销
- 适合需要频繁计算距离的生成模型与配准任务
切片水氏距离(SW)将高维空间的最优传输问题简化为一维投影之和,因此在几何、生成建模和配准任务中广泛应用。近期研究证明,准蒙特卡洛构造(QSW)能生成逼近误差优异的方向集。本文提出一种新方法:在优化循环中(如梯度流),通过贝叶斯优化(BO)学习投影方向。我们设计四类即插即用的方向选择器:BOSW(单次优化)、RBOSW(周期刷新)、ABOSW(基于优质QSW初始集并轻量精修)、ARBOSW(周期重启学习)。这些方法可与QSW及其变体组合使用(如ABOSW/ARBOSW),无需修改下游损失或梯度。数值实验表明,新方法达到当前最优性能;在原始QSW论文的实验基准上,ABOSW与ARBOSW以适度运行开销实现与最优QSW变体相当的收敛速度。
原文摘要 · Abstract (English)
The sliced Wasserstein distance (SW) reduces optimal transport on $\mathbb{R}^d$ to a sum of one-dimensional projections, and thanks to this efficiency, it is widely used in geometry, generative modeling, and registration tasks. Recent work shows that quasi-Monte Carlo constructions for computing SW (QSW) yield direction sets with excellent approximation error. This paper presents an alternate, novel approach: learning directions with Bayesian optimization (BO), particularly in settings where SW appears inside an optimization loop (e.g., gradient flows). We introduce a family of drop-in selectors for projection directions: BOSW, a one-shot BO scheme on the unit sphere; RBOSW, a periodic-refresh variant; ABOSW, an adaptive hybrid that seeds from competitive QSW sets and performs a few lightweight BO refinements; and ARBOSW, a restarted hybrid that periodically relearns directions during optimization. Our BO approaches can be composed with QSW and its variants (demonstrated by ABOSW/ARBOSW) and require no changes to downstream losses or gradients. We provide numerical experiments where our methods achieve state-of-the-art performance, and on the experimental suite of the original QSW paper, we find that ABOSW and ARBOSW can achieve convergence comparable to the best QSW variants with modest runtime overhead.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。