arXiv:2606.18306cs.LGstat.ML2026-06被引 2

提出费舍尔宽度,用于度量统计流形的几何复杂度。

Fisher Width: A Geometric Measure of Complexity on Statistical Manifolds

论文配图:Fisher Width: A Geometric Measure of Complexity on Statistical Manifolds
图 1 · 摘自论文原文
  • 用费舍尔信息度量替代欧氏度量,定义新几何复杂度指标。
  • 在MNIST上验证其可计算性,对三类模型给出泛化界。
  • 保持欧氏宽度核心性质,且能捕捉非各向同性几何特征。

高维概率、压缩感知、凸优化和学习理论中,高斯宽度是核心几何复杂度度量,用于量化集合在随机方向上的平均延伸程度,从而捕获约束集、假设类和下降锥的有效维度。然而,这一概念本质上是欧氏的。统计模型则具有由费舍尔信息度量诱导的自然黎曼几何,其中方向按统计可区分性缩放而非环境欧氏长度。本文引入费舍尔宽度,作为统计流形上高斯宽度的费舍尔几何类比。在参数点θ,费舍尔宽度将欧氏单位矩阵替换为局部度量张量G(θ)^{1/2},测量费舍尔重缩放集合的高斯宽度。这使结果量对局部统计曲率敏感,并在光滑重参数化下不变。我们建立了费舍尔宽度的基本理论,证明其保留了高斯宽度的关键结构特性,包括浓度、度量扰动稳定性以及与欧氏基准的谱比较界,同时还能捕捉欧氏度量无法察觉的各向异性几何效应。作为应用,我们推导出费舍尔-利普希茨假设类的泛化界,并提出可计算估计器,在MNIST上对三类模型进行实证评估。费舍尔宽度之于统计流形,正如高斯宽度之于欧氏凸体。本工作为研究曲面统计流形上的复杂度与学习奠定了基础。

原文摘要 · Abstract (English)

Gaussian width is a central geometric complexity measure in high-dimensional probability, compressed sensing, convex optimization, and learning theory. It quantifies the average extent of a set along random directions, thereby capturing the effective dimension of constraint sets, hypothesis classes, and descent cones. However, this notion is intrinsically Euclidean. Statistical models instead carry a natural Riemannian geometry induced by the Fisher information metric, where directions are scaled according to statistical distinguishability rather than ambient Euclidean length. We introduce Fisher width, a Fisher-geometric analogue of Gaussian width for statistical manifolds. At a parameter point $θ$, Fisher width replaces the Euclidean identity by the local metric tensor $G(θ)^{1/2}$, measuring the Gaussian width of the Fisher-rescaled set. This makes the resulting quantity sensitive to local statistical curvature and invariant under smooth reparameterizations. We develop the basic theory of Fisher width, showing that it retains key structural features of Gaussian width, including concentration, metric perturbation stability, and spectral comparison bounds with the Euclidean baseline, while also capturing anisotropic geometric effects invisible to Euclidean measures. As an application, we prove a generalization bound for Fisher-Lipschitz hypothesis classes and propose computable estimators, which we evaluate empirically on MNIST across three model classes. Fisher width is to statistical manifolds what Gaussian width is to Euclidean convex bodies. This work lays the foundation for studying complexity and learning on curved statistical manifolds.

统计学习几何复杂度费舍尔信息

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。