改进经典估计器方差理论,引入曲率修正项提升小样本精度
On Higher-Order Geometric Refinements of Classical Covariance Asymptotics: An Approach via Intrinsic and Extrinsic Information Geometry
- 将参数族视为黎曼流形,用内在与外在几何构造曲率修正项
- 导出 $n^{-2}$ 阶修正项,外在项半正定,整体保持参数变换不变
- 适用于混合模型、潜变量等奇异模型,可诊断弱可识别性
经典费雪信息渐近理论仅捕捉似然函数的局部二次近似,即一阶几何,无法刻画曲面模型(如混合模型、隐变量模型、流形约束参数空间)的有限样本偏差。本文将正则参数族视为带费雪-劳度度量的黎曼流形 $(Θ,g)$,通过平方根密度映射嵌入 $L^2(μ)$,在合适正则性和矩条件下,推导出对得分根、一阶高效估计器的 $n^{-2}$ 阶方差修正项。该修正由张量 $P_{ij}$ 控制,分解为三部分:内蕴的费雪-劳度曲率张量的里奇型收缩、外在的第二基本形式的格拉姆型收缩,以及编码高阶概率信息的赫林杰差异张量。外在项半正定,整体修正在光滑重参数化下不变,且在完整指数族中恒为零。进一步扩展至奇异模型,利用加性横截假设下的奇点解析,描述解析后度量结构,揭示实对数规范阈值在学习率与后验均方误差中的作用,并在解析空间上建立基于曲率的协方差展开,恢复常规理论作为特例。该框架还提出几何诊断弱可识别性的方法及曲率感知的正则化与优化原则。
原文摘要 · Abstract (English)
Classical Fisher-information asymptotics describe the covariance of regular efficient estimators through the local quadratic approximation of the log-likelihood, and thus capture first-order geometry only. In curved models, including mixtures, curved exponential families, latent-variable models, and manifold-constrained parameter spaces, finite-sample behavior can deviate systematically from these predictions. We develop a coordinate-invariant, curvature-aware refinement by viewing a regular parametric family as a Riemannian manifold \((Θ,g)\) with Fisher--Rao metric, immersed in \(L^2(μ)\) through the square-root density map. Under suitable regularity and moment assumptions, we derive an \(n^{-2}\) correction to the leading \(n^{-1}I(θ)^{-1}\) covariance term for score-root, first-order efficient estimators. The correction is governed by a tensor \(P_{ij}\) that decomposes canonically into three parts, an intrinsic Ricci-type contraction of the Fisher--Rao curvature tensor, an extrinsic Gram-type contraction of the second fundamental form, and a Hellinger discrepancy tensor encoding higher-order probabilistic information not determined by immersion geometry alone. The extrinsic term is positive semidefinite, the full correction is invariant under smooth reparameterization, and it vanishes identically for full exponential families. We then extend the picture to singular models, where Fisher information degenerates. Using resolution of singularities under an additive normal crossing assumption, we describe the resolved metric, the role of the real log canonical threshold in learning rates and posterior mean-squared error, and a curvature-based covariance expansion on the resolved space that recovers the regular theory as a special case. This framework also suggests geometric diagnostics of weak identifiability and curvature-aware principles for regularization and optimization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。