arXiv:2606.07931math.PRcond-mat.stat-mech2026-06被引 2

提出高斯过程的点态复杂度上界,实现对整个场的高概率控制。

Pointwise Complexity for Gaussian Fields: Upper Envelopes, Algorithmic Lower Bounds, and Separation

  • 基于点态Fernique-Talagrand泛函与高斯尾部项,构建全场统一上界。
  • 首次给出贝叶斯算法下界,依赖于精确的鬼球质量而非最坏覆盖数。
  • 揭示经典极小极大理论在过参数化场景下的局限性,适合高维统计研究者。

我们证明了中心高斯过程的方差感知点态主导测度定理。经典泛化链刻画标量期望 $\mathbb E\sup_{x\in T}X_x$;而本定理提供整个场的高概率上包络。对于环境先验 $μ$,点 $x$ 处的包络由点态Fernique-Talagrand泛函 \\[Φ_μ(x):=\int_0^{4σ(x)}\sqrt{\log\frac{1}{μ(B_d(x,\varepsilon))}}\,d\varepsilon\ ] 和对应高斯尾部项共同决定。该定理实现了经典泛化链的可复用场级改进,并为深度神经网络的点态经验过程界提供了高斯过程类比。我们还通过交互Fano/数据处理原理记录了贝叶斯算法下界。对已知先验 $π$、观测信道和具体估计器 $\widehat t(Y)$,下界由精确鬼球小球质量 $\mathbb E_{Y\sim Q}π(B_d(\widehat t(Y),Δ))$ 表示,而非最坏覆盖数。在高斯位置实验中,比较解码器将贝叶斯位置误差转化为决策对齐的高斯范围下界。随后构造了一个基础例子,分离了通常Fano松弛、贝叶斯算法下界、点态高斯上界及全类极小极大风险。这些结果表明,算法下界在过参数化环境中为固定估计器的点态复杂度提供了局部几何验证,恰在经典极小极大理论过于粗糙或依赖预言机的区域。该分离亦可重述为极小极大语言中的惩罚-范围信息松弛,凸显经典高维模型与正则化算法的算法鲁棒性关键问题。

原文摘要 · Abstract (English)

We prove a variance-aware pointwise majorizing-measure theorem for centered Gaussian processes. Classical generic chaining characterizes the scalar quantity $\mathbb E\sup_{x\in T}X_x$; the theorem here gives a simultaneous high-probability envelope for the entire field. For an ambient prior $μ$, the envelope at $x$ is governed by a pointwise Fernique-Talagrand functional \[Φ_μ(x):=\int_0^{4σ(x)}\sqrt{\log\frac{1}{μ(B_d(x,\varepsilon))}}\,d\varepsilon,\] together with the corresponding Gaussian tail term. The theorem provides a reusable field-level refinement of classical generic chaining and a Gaussian-process counterpart of pointwise empirical-process bounds for deep neural networks. We also record a Bayesian algorithmic lower envelope from the interactive Fano/data-processing principle. For a known prior $π$, an observation channel, and a concrete estimator $\widehat t(Y)$, the lower bound is expressed through the exact ghost small-ball mass $\mathbb E_{Y\sim Q}π(B_d(\widehat t(Y),Δ))$, rather than a worst-case covering number. In Gaussian location experiments, comparison decoders convert Bayes location error into lower bounds on decision-aligned Gaussian ranges. We then construct an elementary example separating the usual Fano relaxation, the Bayesian algorithmic lower envelope, the pointwise Gaussian envelope, and the full-class minimax risk. Together, these results show that algorithmic lower bounds provide local-geometric validations of pointwise complexity for fixed estimators in overparameterized ambient classes, precisely in regimes where classical minimax theory becomes either too coarse or oracle-dependent. This separation can also be recast in minimax language as penalty-range information relaxation, highlighting an important question of algorithmic robustness for classical high-dimensional models and regularized algorithms.

高斯过程点态复杂度算法下界极小极大

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。