提出新型深度函数空间模型,实现复杂度与精度的可控平衡。
Variation Brownian Kernel Ladders
- 将递归字典构建与线性变差叠加分离,基于布朗核希尔伯特空间构造原子
- 在局部非退化条件下,证明深度增长带来严格正则性提升与紧性
- 适用于小样本场景,具可解释的逼近误差界和高效基函数使用
深度模型的有效性依赖于表示复杂度的设定。本文提出变分布朗核梯子(VBKL),一种路径原子函数空间框架,将非线性递归字典构建与线性变差叠加分离。从线性投影出发,每个原子递归地从布朗再生核希尔伯特空间(RKHS)中组合单位球轮廓;完整VBKL空间是完备字典的带符号测度变差包。我们识别出每层递归字典为布朗拉回RKHS球的并集,证明在局部非退化条件下,变差控制的霍尔德正则性、紧性和深度增长性均成立,该条件的迹位于输入测度支持内。针对有限低支撑架构,通过布朗二次混沌、带符号阈值迹和VC熵推导出径向基函数和泛化界。进一步通过离散外测度与选中外布朗轮廓构建两阶段近似器,获得 $M^{-1/2}+m^{-1/2}$ 的误差界、精确插值常数 $\ ext{sqrt}(A/2)$,且每次评估最多有 $2M$ 个活跃外轮廓基贡献。受控实验揭示逼近机制,并显示在小数据下具有优异的精度-复杂度权衡。
原文摘要 · Abstract (English)
Claims about the benefit of depth depend on the complexity assigned to a representation. We introduce the \emph{Variation Brownian Kernel Ladder} (VBKL), a path-atomic function-space framework that separates nonlinear recursive dictionary construction from linear variation superposition. Starting from linear projections, each atom recursively composes unit-ball profiles from the Brownian reproducing kernel Hilbert space; the full VBKL space is then the signed-measure variation hull of the completed dictionary. We identify each recursive dictionary as a union of Brownian pullback RKHS balls and establish variation-controlled Hölder regularity, compactness and attainment, and strict growth with depth under a local non-degeneracy condition whose trace lies in the support of the input measure. For associated finite lower-support architectures, we derive Rademacher and generalization bounds through Brownian quadratic chaos, signed threshold traces, and VC entropy. We also construct two-stage approximants by discretizing the outer measure and the selected outer Brownian profiles, obtaining an $M^{-1/2}+m^{-1/2}$ error bound, a sharp interpolation constant $\sqrt{A/2}$, and at most $2M$ active outer-profile basis contributions per evaluation. Controlled experiments illustrate the approximation mechanisms and indicate a favorable limited-data accuracy--complexity trade-off.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。