发现主流降维评估指标对缩放敏感,提出简单修正方法
How Scale Breaks "Normalized Stress" and KL Divergence: Rethinking Quality Metrics
- 分析并实证应力与KL散度在数据缩放下的失真现象
- 缩放后指标值剧烈变化,误导降维方法评估结果
- 提出缩放不变性修正,提升评估可靠性,适合可视化研究者
高维复杂数据广泛存在于机器学习、生物和社科等领域。常用二维散点图可视化数据,但难以主观判断其准确性,因此依赖质量指标评估投影效果。当前最常用的标准化应力指标对均匀缩放(拉伸或压缩)敏感,而该操作并不改变投影本质。另一常用指标KL散度(t-SNE中使用)同样存在此问题。本文通过理论分析与实证研究,揭示缩放如何显著改变这两项指标的数值,并影响降维方法的评价。提出一种简单有效的修正方法,使指标具备缩放不变性,并在小型基准测试中验证其能准确反映预期行为。
原文摘要 · Abstract (English)
Complex, high-dimensional data is ubiquitous across many scientific disciplines, including machine learning, biology, and the social sciences. One of the primary methods of visualizing these datasets is with two-dimensional scatter plots that visually capture some properties of the data. Because visually determining the accuracy of these plots is challenging, researchers often use quality metrics to measure the projection's accuracy and faithfulness to the original data. One of the most commonly employed metrics, normalized stress, is sensitive to uniform scaling (stretching, shrinking) of the projection, despite this act not meaningfully changing anything about the projection. Another quality metric, the Kullback--Leibler (KL) divergence used in the popular t-Distributed Stochastic Neighbor Embedding (t-SNE) technique, is also susceptible to this scale sensitivity. We investigate the effect of scaling on stress and KL divergence analytically and empirically by showing just how much the values change and how this affects dimension reduction technique evaluations. We introduce a simple technique to make both metrics scale-invariant and show that it accurately captures expected behavior on a small benchmark.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。