arXiv:2412.19212cs.LG2024-12AAAI被引 2

提出自适应投影方向的球面切片Wasserstein距离,提升分布差异度量精度。

Towards Better Spherical Sliced-Wasserstein Distance Learning with Data-Adaptive Discriminative Projection Direction

  • 用能量函数动态加权投影方向,让重要方向影响更大
  • 两种加权方式:非参数函数与神经网络,性能优于原方法
  • 适用于地质、视觉等球面数据分布对比,适合做表征学习

球面切片Wasserstein(SSW)被用于测量地质、医学、计算机视觉及深度表征学习等领域中球面数据分布的差异。然而,原始SSW对所有投影方向同等对待,过于理想化,无法反映不同方向对各类数据分布的重要性差异。为此,本文提出新型数据自适应判别性球面切片Wasserstein(DSSW)距离,利用投影能量函数确定判别性投影方向。DSSW引入两类投影能量函数:第一类为非参数确定性函数,将投影Wasserstein距离转化为各方向权重,性能提升显著且计算开销可忽略;第二类为神经网络诱导函数,通过参数化网络学习投影方向权重,进一步提升性能且额外开销更小。实验在梯度流、真实地球数据密度估计和自监督学习等多种任务中验证了DSSW优于多个先进方法。

原文摘要 · Abstract (English)

Spherical Sliced-Wasserstein (SSW) has recently been proposed to measure the discrepancy between spherical data distributions in various fields, such as geology, medical domains, computer vision, and deep representation learning. However, in the original SSW, all projection directions are treated equally, which is too idealistic and cannot accurately reflect the importance of different projection directions for various data distributions. To address this issue, we propose a novel data-adaptive Discriminative Spherical Sliced-Wasserstein (DSSW) distance, which utilizes a projected energy function to determine the discriminative projection direction for SSW. In our new DSSW, we introduce two types of projected energy functions to generate the weights for projection directions with complete theoretical guarantees. The first type employs a non-parametric deterministic function that transforms the projected Wasserstein distance into its corresponding weight in each projection direction. This improves the performance of the original SSW distance with negligible additional computational overhead. The second type utilizes a neural network-induced function that learns the projection direction weight through a parameterized neural network based on data projections. This further enhances the performance of the original SSW distance with less extra computational overhead. Finally, we evaluate the performance of our proposed DSSW by comparing it with several state-of-the-art methods across a variety of machine learning tasks, including gradient flows, density estimation on real earth data, and self-supervised learning.

分布度量球面数据Wasserstein自适应加权

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。