arXiv:2504.02544cs.LGcs.AI2025-04ICLR被引 11

提出一种新嵌入方法,让多集和测度在欧氏空间中保持几何结构。

Fourier Sliced-Wasserstein Embedding for Multisets and Measures

  • 通过傅里叶切片技术将分布映射到欧氏空间,保留切片沃瑟斯坦距离。
  • 输出维度约2Nd,对多集为双李普希茨,对测度为单射,性能接近理论极限。
  • 适合需要精确分布表示的任务,如点云学习、距离估计等。

我们提出傅里叶切片沃瑟斯坦(FSW)嵌入——一种将定义在ℝᵈ上的多集和测度映射到欧氏空间的新方法。该嵌入近似保持分布间的切片沃瑟斯坦距离,从而生成具有几何意义的表示,更准确捕捉输入结构。它在测度上是单射,在多集上为双李普希茨,优于普遍使用的求和或最大池化方法(后者在理论上既非双李普希茨,也非单射)。实现这些性质所需的输出维度约为2Nd,其中N为输入多集的最大大小,已接近最优。此外,我们证明:无法以双李普希茨方式将ℝᵈ上的分布嵌入欧氏空间。因此,本方法的度量特性在某种意义上已达最优。数值实验表明,该方法在实际学习任务中表现优异:(a) FSW嵌入与MLP结合即可达到非切片沃瑟斯坦距离学习的当前最优性能;(b) 用FSW嵌入替代最大池化后,PointNet在参数减少40倍时仍保持较高鲁棒性,性能下降微小。

原文摘要 · Abstract (English)

We present the Fourier Sliced-Wasserstein (FSW) embedding - a novel method to embed multisets and measures over $\mathbb{R}^d$ into Euclidean space. Our proposed embedding approximately preserves the sliced Wasserstein distance on distributions, thereby yielding geometrically meaningful representations that better capture the structure of the input. Moreover, it is injective on measures and bi-Lipschitz on multisets - a significant advantage over prevalent methods based on sum- or max-pooling, which are provably not bi-Lipschitz, and, in many cases, not even injective. The required output dimension for these guarantees is near-optimal: roughly $2 N d$, where $N$ is the maximal input multiset size. Furthermore, we prove that it is impossible to embed distributions over $\mathbb{R}^d$ into Euclidean space in a bi-Lipschitz manner. Thus, the metric properties of our embedding are, in a sense, the best possible. Through numerical experiments, we demonstrate that our method yields superior multiset representations that improve performance in practical learning tasks. Specifically, we show that (a) a simple combination of the FSW embedding with an MLP achieves state-of-the-art performance in learning the (non-sliced) Wasserstein distance; and (b) replacing max-pooling with the FSW embedding makes PointNet significantly more robust to parameter reduction, with only minor performance degradation even after a 40-fold reduction.

嵌入测度点云优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。