用斐波那契递推机制构建动态集成学习模型,提升预测精度与泛化能力。
Fibonacci-Driven Recursive Ensembles: Algorithms, Convergence, and Learning Dynamics
- 采用二阶递推更新,每个预测器依赖前两个结果,引入记忆性学习机制。
- 在核岭回归等模型上验证,递推权重显著优于静态加权,提升逼近与泛化性能。
- 理论完备,涵盖收敛性、稳定性及非渐近泛化界,适合机器学习研究者参考。
本文建立了基于斐波那契型更新流的递归集成学习的算法与动力学基础。不同于传统提升方法中的一阶加性更新,本工作研究二阶递归结构,其中每个预测器依赖于其两个直接前驱。这种斐波那契流引入了具有记忆性的学习动态,使集成模型能融合历史结构并适应新残差信息。我们提出一类广义递归权重更新算法,涵盖斐波那契、三阶斐波那契及更高阶递推,并推导其连续时间极限,形成描述集成演化的微分方程系统。建立了全局收敛条件、谱稳定性判据以及基于Rademacher复杂度和算法稳定性的非渐近泛化界。该理论统一了递归集成、结构化加权与动力系统视角。在核岭回归(Rasmussen and Williams, 2006)、样条平滑器(Wahba, 1990)和随机傅里叶特征模型(Rahimi and Recht, 2007)上的实验表明,递推流持续优于静态加权,在逼近与泛化上表现更优。成果完成了从斐波那契加权、几何加权理论到全动态递归集成系统的三部曲。
原文摘要 · Abstract (English)
This paper develops the algorithmic and dynamical foundations of recursive ensemble learning driven by Fibonacci-type update flows. In contrast with classical boosting Freund and Schapire (1997); Friedman (2001), where the ensemble evolves through first-order additive updates, we study second-order recursive architectures in which each predictor depends on its two immediate predecessors. These Fibonacci flows induce a learning dynamic with memory, allowing ensembles to integrate past structure while adapting to new residual information. We introduce a general family of recursive weight-update algorithms encompassing Fibonacci, tribonacci, and higher-order recursions, together with continuous-time limits that yield systems of differential equations governing ensemble evolution. We establish global convergence conditions, spectral stability criteria, and non-asymptotic generalization bounds under Rademacher Bartlett and Mendelson (2002) and algorithmic stability analyses. The resulting theory unifies recursive ensembles, structured weighting, and dynamical systems viewpoints in statistical learning. Experiments with kernel ridge regression Rasmussen and Williams (2006), spline smoothers Wahba (1990), and random Fourier feature models Rahimi and Recht (2007) demonstrate that recursive flows consistently improve approximation and generalization beyond static weighting. These results complete the trilogy begun in Papers I and II: from Fibonacci weighting, through geometric weighting theory, to fully dynamical recursive ensemble learning systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。