arXiv:2507.13194stat.MLcs.LG2025-07

提出无需优化的高效切片分布,提升跨域对齐计算速度与精度

Relation-Aware Slicing in Cross-Domain Alignment

  • 基于关系感知投影方向构建无优化切片分布,实现快速采样
  • 在多个对齐任务中显著优于传统SGW,计算效率更高
  • 适合需要高效跨域匹配的场景,如图像/文本对齐

Sliced Gromov-Wasserstein (SGW) 距离通过从单位超球面均匀采样投影方向来降低 Gromov-Wasserstein 距离求解的计算成本,但该切片机制因包含无信息方向而带来额外开销,削弱了距离的表征能力。寻找更优的投影方向分布通常需额外优化,反而增加计算负担。为此,本文提出一种无需优化的切片分布:引入关系感知投影方向(RAPD),有效捕捉两组随机向量间的成对关联性,从而推导出对应的关系感知切片分布(RASD),其为基于样本RAPD的定位缩放律。进一步提出RASGW及其变体IWRASGW,克服了SGW的不足。理论分析与大量实验验证了其优越性。

原文摘要 · Abstract (English)

The Sliced Gromov-Wasserstein (SGW) distance, aiming to relieve the computational cost of solving a non-convex quadratic program that is the Gromov-Wasserstein distance, utilizes projecting directions sampled uniformly from unit hyperspheres. This slicing mechanism incurs unnecessary computational costs due to uninformative directions, which also affects the representative power of the distance. However, finding a more appropriate distribution over the projecting directions (slicing distribution) is often an optimization problem in itself that comes with its own computational cost. In addition, with more intricate distributions, the sampling itself may be expensive. As a remedy, we propose an optimization-free slicing distribution that provides fast sampling for the Monte Carlo approximation. We do so by introducing the Relation-Aware Projecting Direction (RAPD), effectively capturing the pairwise association of each of two pairs of random vectors, each following their ambient law. This enables us to derive the Relation-Aware Slicing Distribution (RASD), a location-scale law corresponding to sampled RAPDs. Finally, we introduce the RASGW distance and its variants, e.g., IWRASGW (Importance Weighted RASGW), which overcome the shortcomings experienced by SGW. We theoretically analyze its properties and substantiate its empirical prowess using extensive experiments on various alignment tasks.

跨域对齐概率度量高效算法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。