用几何方法区分数据真实变化与参数化干扰,更准确追踪高维表征演化。
Fubini Study geometry of representation drift in high dimensional data
- 基于费比尼-施图迪度量,识别仅由全局缩放或符号翻转引起的表征差异。
- 在实际数据上发现传统角度距离会夸大变化,而新方法能分离出真实演化轨迹。
- 适合关注模型稳定性、表征演化分析的研究者,尤其适用于深度学习可解释性研究。
高维表征漂移通常用欧氏或余弦距离衡量,这些方法假设坐标系固定,将数据本质变化与任意参数化引入的波动混为一谈。本文提出基于费比尼-施图迪(Fubini Study)度量的投影几何视角,可识别仅由规范变换(如全局缩放、符号翻转)导致的表征差异。在真实高维数据集上,我们构建表征轨迹并追踪累积几何漂移。对比欧氏、余弦与费比尼-施图迪距离发现:当表征存在投影模糊性时,传统度量系统性地高估变化;而费比尼-施图迪度量对规范变换保持不变,能分离出内在演化。进一步证明,余弦与费比尼-施图迪漂移之差是一个可计算、单调递增的量,直接反映由规范自由度引发的表征震荡。该分离机制提供了一种无需依赖模型假设的诊断工具,用于区分有意义的结构演化与参数化伪影。整体上,本文建立了一套评估高维系统表征稳定性的几何准则,并阐明了角度距离的局限性。将表征动态嵌入投影空间,使数据分析与经典几何框架对接,产生的可观测量可直接应用于实证流程。
原文摘要 · Abstract (English)
High dimensional representation drift is commonly quantified using Euclidean or cosine distances, which presuppose fixed coordinates when comparing representations across time, training or preprocessing stages. While effective in many settings, these measures entangle intrinsic changes in the data with variations induced by arbitrary parametrizations. We introduce a projective geometric view of representation drift grounded in the Fubini Study metric, which identifies representations that differ only by gauge transformations such as global rescalings or sign flips. Applying this framework to empirical high dimensional datasets, we explicitly construct representation trajectories and track their evolution through cumulative geometric drift. Comparing Euclidean, cosine and Fubini Study distances along these trajectories reveals that conventional metrics systematically overestimate change whenever representations carry genuine projective ambiguity. By contrast, the Fubini Study metric isolates intrinsic evolution by remaining invariant under gauge-induced fluctuations. We further show that the difference between cosine and Fubini Study drift defines a computable, monotone quantity that directly captures representation churn attributable to gauge freedom. This separation provides a diagnostic for distinguishing meaningful structural evolution from parametrization artifacts, without introducing model-specific assumptions. Overall, we establish a geometric criterion for assessing representation stability in high-dimensional systems and clarify the limits of angular distances. Embedding representation dynamics in projective space connects data analysis with established geometric programs and yields observables that are directly testable in empirical workflows.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。