arXiv:2607.27463cs.LGcs.HC2026-07

提出FADEx解释降维中特征如何影响数据点位置,提升可解释性。

FADEx: Feature Attribution and Distortion-based Explanation of Dimensionality Reduction

论文配图:FADEx: Feature Attribution and Distortion-based Explanation of Dimensionality Reduction
图 1 · 摘自论文原文
  • 用泰勒展开和SVD构建局部线性模型,实现特征归因与畸变分析。
  • 无需外部数据映射,适用于任意非线性降维方法,解释更稳定。
  • 适合研究降维结果的结构模式,尤其适合数据科学家和算法开发者。

降维(DR)是高维数据探索的基础工具,能简化机器学习模型的潜在空间复杂度,并辅助解释复杂的黑箱模型。然而,非线性降维技术本身常为黑箱,难以理解单个特征如何影响实例在低维空间中的布局。这种不透明性阻碍了对结构模式的分析与解读。为此,已有降维解释方法试图提升对聚类结构的理解,但普遍存在特征多重归因、仅适配特定降维方法等问题。本文提出FADEx,一种基于一阶泰勒展开与奇异值分解的局部实例级特征归因方法,通过加权最小二乘构建局部线性模型,无需样本外数据映射,具备方法无关性,同时提供局部特征贡献与畸变分析。通过定性与定量评估、与现有方法对比及案例研究,验证了FADEx在解释效果与通用性上的优越性,其解释结果稳健可靠,多方面优于现有方法。

原文摘要 · Abstract (English)

Dimensionality Reduction (DR) is a fundamental tool for high-dimensional data exploration, reducing the complexity of latent spaces of machine learning models, and assisting in the explanation of complex opaque models. However, non-linear DR techniques often function as opaque transformations themselves, making it challenging to understand how individual features influence instance positioning in the reduced space. This lack of transparency complicates the analysis and interpretation of structural patterns, hindering the ability to reason about the organization of high-dimensional data based on the projected layout. In order to address this challenge, dimensionality reduction explanation methods have shown promise in improving the understanding of the observed groups and cluster structures. Unfortunately, existing DR explanation approaches tend to suffer from limitations such as multiple attributions per feature and restricted applicability to specific dimensionality reduction methods, which hinder their use. In this work, we propose FADEx, a novel local per-instance feature attribution method that leverages local linear approximation via first-order Taylor expansion and Singular Value Decomposition to provide explanations. FADEx computes the local linear models via weighted least squares, eliminating the need for out-of-sample data mapping, making it agnostic to the DR method, while simultaneously providing local feature attributions and distortion analysis. Through qualitative and quantitative evaluations, comparisons with existing methods, and case studies, we demonstrate FADEx's effectiveness and versatility in providing explanations and analytical resources for analyzing the behavior of DR methods. The results indicate FADEx yields robust and reliable explanations, outperforming existing approaches in several aspects.

降维解释特征归因可解释性局部模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。