arXiv:2512.22284stat.MLcs.LG2025-12被引 1

用斐波那契数列设计新型集成学习,提升模型稳定性和表达能力。

On Fibonacci Ensembles: An Alternative Approach to Ensemble Learning Inspired by the Timeless Architecture of the Golden Ratio

  • 基于斐波那契加权与正交化优化,系统降低基学习器方差。
  • 在1维回归实验中表现优于均匀平均,且与Rao-Blackwell化协同增效。
  • 适合关注模型可解释性与自然规律启发的集成学习研究者。

自然界常以隐晦方式揭示其奥秘,而斐波那契序列则展现了一种生长、和谐与递归稳定的内在架构。本文提出一种名为「斐波那契集成」(Fibonacci Ensembles)的数学严谨且哲学启发的集成学习框架,补充并扩展了经典的袋装法、提升法与随机森林等方法。该框架包含两个核心机制:(1) 通过正交化和Rao–Blackwell优化处理的归一化斐波那契权重,实现基学习器间方差的系统性降低;(2) 一种二阶递归动态结构,模拟斐波那契演化过程,增强表示深度,超越传统提升法。通过使用随机傅里叶特征集成与多项式集成的控制性一维回归实验,结果表明斐波那契加权在某些情形下可媲美或优于均匀平均,并与正交化优化形成原理性协同。这些发现表明,斐波那契集成是集成学习理论中一个自然且可解释的设计点。

原文摘要 · Abstract (English)

Nature rarely reveals her secrets bluntly, yet in the Fibonacci sequence she grants us a glimpse of her quiet architecture of growth, harmony, and recursive stability \citep{Koshy2001Fibonacci, Livio2002GoldenRatio}. From spiral galaxies to the unfolding of leaves, this humble sequence reflects a universal grammar of balance. In this work, we introduce \emph{Fibonacci Ensembles}, a mathematically principled yet philosophically inspired framework for ensemble learning that complements and extends classical aggregation schemes such as bagging, boosting, and random forests \citep{Breiman1996Bagging, Breiman2001RandomForests, Friedman2001GBM, Zhou2012Ensemble, HastieTibshiraniFriedman2009ESL}. Two intertwined formulations unfold: (1) the use of normalized Fibonacci weights -- tempered through orthogonalization and Rao--Blackwell optimization -- to achieve systematic variance reduction among base learners, and (2) a second-order recursive ensemble dynamic that mirrors the Fibonacci flow itself, enriching representational depth beyond classical boosting. The resulting methodology is at once rigorous and poetic: a reminder that learning systems flourish when guided by the same intrinsic harmonies that shape the natural world. Through controlled one-dimensional regression experiments using both random Fourier feature ensembles \citep{RahimiRecht2007RFF} and polynomial ensembles, we exhibit regimes in which Fibonacci weighting matches or improves upon uniform averaging and interacts in a principled way with orthogonal Rao--Blackwellization. These findings suggest that Fibonacci ensembles form a natural and interpretable design point within the broader theory of ensemble learning.

集成学习斐波那契加权策略可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。