提出新度量方法CFD,精准评估表示空间中数据组的融合与分离程度。
Cross-Fusion Distance: A Novel Metric for Measuring Fusion and Separability Between Data Groups in Representation Space
- 基于几何位移设计新度量,区分影响融合的关键因素
- 在真实数据集上与下游泛化性能更一致
- 计算高效且理论可解释,适合领域偏移场景
在表示学习中,量化表示空间内数据组之间的融合与分离程度是基础问题,尤其在领域偏移情况下。一个有意义的度量应捕捉几何位移等会改变融合程度的因素,同时对全局缩放和采样引起的布局变化等不改变融合的因素保持不变。现有分布距离度量混淆了这些因素,导致度量无法反映真实的融合程度。本文提出交叉融合距离(Cross-Fusion Distance, CFD),一种原理性度量,能分离出影响融合的几何特征,同时对融合保持不变的扰动具有鲁棒性,具有线性计算复杂度。我们从理论上刻画了CFD的不变性与敏感性,并在受控合成实验中验证。在具有领域偏移的真实数据集上,CFD比常用替代方法更贴近下游泛化性能下降情况。总体而言,CFD为表示学习提供了理论严谨且可解释的距离度量。
原文摘要 · Abstract (English)
Quantifying degrees of fusion and separability between data groups in representation space is a fundamental problem in representation learning, particularly under domain shift. A meaningful metric should capture fusion-altering factors like geometric displacement between representation groups, whose variations change the extent of fusion, while remaining invariant to fusion-preserving factors such as global scaling and sampling-induced layout changes, whose variations do not. Existing distributional distance metrics conflate these factors, leading to measures that are not informative of the true extent of fusion between data groups. We introduce Cross-Fusion Distance (CFD), a principled measure that isolates fusion-altering geometry while remaining robust to fusion-preserving variations, with linear computational complexity. We characterize the invariance and sensitivity properties of CFD theoretically and validate them in controlled synthetic experiments. For practical utility on real-world datasets with domain shift, CFD aligns more closely with downstream generalization degradation than commonly used alternatives. Overall, CFD provides a theoretically grounded and interpretable distance measure for representation learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。