arXiv:2606.15812cs.LG2026-06

构建递归核空间层次,实现自适应表示与高效统计学习。

Brownian Kernel Ladders

  • 用布朗运动核逐层构造希尔伯特空间层级,保持正则性。
  • 有限字典下实现近参数化统计速率,无维度依赖项。
  • 适用于需要自适应复杂度的高维数据建模任务。

我们提出布朗运动核梯子(BKL),一种从线性泛函出发、通过反复积分布朗拉回核构建的递归积分再生核希尔伯特空间层次。布朗核的1-齐次性带来保核球面归一化,并在层级间传递平方根正则性。允许所有标准梯度测度变化可得全自适应BKL包络,其复杂度极小。我们证明了深度相关的霍尔德和逐点估计、拟巴拿赫结构、嵌套性,以及在几何迹条件下球面分离下的严格增长。对连续损失函数,建立了正则化经验风险最小化解的存在性;严格凸下几乎处处唯一,全支撑下逐点唯一。统计估计中,研究单个实现的梯子与独立于样本的有限词典。当词典含M个梯子时,顶层RKHS球并集的高斯复杂度具有n^{-1/2}依赖,无显式环境维数因子,模型选择因子为1+√(2ln M)。相应高概率最优与过剩风险界成立;多项式大小词典仍保持近参数率。理论将自适应表征丰富性与梯子选择的统计代价分离。

原文摘要 · Abstract (English)

We introduce Brownian kernel ladders (BKLs), a recursive hierarchy of integral reproducing kernel Hilbert spaces built from linear functionals by repeatedly integrating Brownian pullback kernels indexed by functions from the preceding layer. The nonnegative 1-homogeneity of the Brownian kernel yields a kernel-preserving canonical spherical normalization and propagates square-root regularity through the hierarchy. Allowing all canonical ladder measures to vary produces a full adaptive BKL envelope with an infimal complexity. For this envelope, we prove depth-dependent Hölder and pointwise estimates, quasi-Banach structure, nestedness, and, under a geometric trace condition, strict growth with ballwise separation. We also establish existence of regularized empirical-risk minimizers for continuous losses uniformly bounded below, with almost-everywhere uniqueness of population predictions under strict convexity and pointwise uniqueness under full support. For statistical estimation, we study one realized ladder and finite dictionaries fixed independently of the estimation sample. For a dictionary of $M$ ladders, the Gaussian complexity of the union of radius-$r$ top-layer RKHS balls has $n^{-1/2}$ dependence, no explicit ambient-dimension factor, and model-selection factor $1+\sqrt{2\ln M}$. Corresponding high-probability oracle and excess-risk bounds follow; polynomial-size dictionaries retain a near-parametric rate. The theory separates adaptive representational richness from the statistical cost of ladder selection.

核方法递归结构统计学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。