arXiv:2605.14524stat.MLcs.LG2026-05

拓展核岭回归到高维乘积核,揭示新收敛规律

Large Dimensional Kernel Ridge Regression: Extending to Product Kernels

  • 构建广义高维乘积核家族,突破传统假设限制
  • 发现样本量变化时出现周期性平台与多峰下降现象
  • 适用于分析复杂核函数的泛化性能,适合理论研究者

近期研究表明,高维核岭回归(KRR)中存在饱和效应与多重下降行为。但这些结论主要基于球面上内积核或强特征函数假设(如超收缩性),其他核函数是否具备类似现象仍不清楚。本文提出一类新的广义高维核,并推导其泛化误差的收敛速率。结果表明,在该框架下可重现此前仅在球面内积核中观察到的关键现象:当源条件 $s\le 1$ 时达到极小最大最优;当 $s>1$ 时出现饱和效应;且在样本数 $n$ 变化时,收敛率呈现周期性平台及多重下降行为。

原文摘要 · Abstract (English)

Recent studies have reported $\textit{saturation effects}$ and $\textit{multiple descent behavior}$ in large dimensional kernel ridge regression (KRR). However, these findings are predominantly derived under restrictive settings, such as inner product kernels on sphere or strong eigenfunction assumptions like hypercontractivity. Whether such behaviors hold for other kernels remains an open question. In this paper, we establish a broad, new family of large dimensional kernels and derive the corresponding convergence rates of the generalization error. As a result, we recover key phenomena previously associated with inner product kernels on sphere, including: $i)$ the $\textit{minimax optimality}$ when the source condition $s\le 1$; $ii)$ the $\textit{saturation effect}$ when $s>1$; $iii)$ a $\textit{periodic plateau phenomenon}$ in the convergence rate and a $\textit {multiple-descent behavior}$ with respect to the sample size $n$.

核方法泛化误差高维统计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。