让模型学会反思自己学习过程,实现自我进化。
Recurrent Expansion: A Pathway Toward the Next Generation of Deep Learning
- 通过分析模型行为轨迹实现迭代优化
- 多实例并行聚合信号提升学习效率
- 适合追求自适应智能系统的研究者
本文提出循环扩展(Recurrent Expansion, RE)这一新学习范式,突破传统机器学习与深度学习对静态数据表征的依赖。RE引入模型自身演化行为作为新维度,通过相同深度架构对数据进行多次映射,并结合损失等性能信号分析其内部特征图,实现模型版本间的自我改进。该框架进一步拓展为多宇宙RE(MVRE),通过并行模型实例聚合信号;再发展为异构MVRE(HMVRE),融合不同架构模型的多样性视角。针对实际部署,提出可扩展自适应变体Sc-HMVRE,引入选择性机制与规模多样性。整体上,RE推动深度学习从表征学习转向行为感知、自我演化的系统,为构建可推理自身学习动态的智能模型奠定基础,指明了迈向可扩展、内省式与自适应人工智能的路径。代码示例可在论文附录中获取。
原文摘要 · Abstract (English)
This paper introduces Recurrent Expansion (RE) as a new learning paradigm that advances beyond conventional Machine Learning (ML) and Deep Learning (DL). While DL focuses on learning from static data representations, RE proposes an additional dimension: learning from the evolving behavior of models themselves. RE emphasizes multiple mappings of data through identical deep architectures and analyzes their internal representations (i.e., feature maps) in conjunction with observed performance signals such as loss. By incorporating these behavioral traces, RE enables iterative self-improvement, allowing each model version to gain insight from its predecessors. The framework is extended through Multiverse RE (MVRE), which aggregates signals from parallel model instances, and further through Heterogeneous MVRE (HMVRE), where models of varying architectures contribute diverse perspectives. A scalable and adaptive variant, Sc-HMVRE, introduces selective mechanisms and scale diversity for real-world deployment. Altogether, RE presents a shift in DL: from purely representational learning to behavior-aware, self-evolving systems. It lays the groundwork for a new class of intelligent models capable of reasoning over their own learning dynamics, offering a path toward scalable, introspective, and adaptive artificial intelligence. A simple code example to support beginners in running their own experiments is provided in Code Availability Section of this paper.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。