提出可自反思的神经网络机制,实现动态内部回路计算。
Recursive Dynamics in Fast-Weights Homeostatic Reentry Networks: Toward Reflective Intelligence
- 通过快速权重与自稳态反馈构建内部递归结构
- 当反馈增益γ在0.10~0.20时,系统出现稳定且具表达力的反射态
- 适用于研究意识、自我参照认知的神经网络建模
本文提出快权重自稳态再入层(FH-RL),融合快速权重关联记忆、自稳态正则化与可学习的再入反馈,模拟神经网络中的自指计算。不同于推理时仅前向传播的标准Transformer,FH-RL在不依赖外部循环的情况下实现内部递归,使先前隐状态能动态重入当前计算流。通过调节再入增益γ,我们引入三项新指标评估涌现的内部动态:信息再入率(IRR)、特征谱递归指数(ESRI)与表征漂移周期性(RDP)。结果表明,再入量随γ增加而线性增长,学习反馈矩阵Wr在中等γ下保持有界且更结构化。关键发现:当γ≈0.10–0.20时,系统出现稳定反射带——IRR平滑上升,ESRI趋近零,RDP呈现一致低频振荡。这为反馈放大与自稳态调控间精巧平衡如何催生类思维的内省处理提供了量化证据,将现代快权重架构与皮层再入及递归认知理论相连接。
原文摘要 · Abstract (English)
This study introduces the Fast-Weights Homeostatic Reentry Layer (FH-RL), a neural mechanism that integrates fast-weight associative memory, homeostatic regularization, and learned reentrant feedback to approximate self-referential computation in neural networks. Unlike standard transformer architectures that operate in a purely feedforward manner during inference, FH-RL enables internal recurrence without external looping, allowing prior latent states to be dynamically re-entered into the ongoing computation stream. We conduct controlled experiments sweeping the reentry gain $γ$ and evaluate emergent internal dynamics using three novel metrics: the Information Reentry Ratio (IRR), Eigen-Spectrum Recursion Index (ESRI), and Representational Drift Periodicity (RDP). Results show that reentry quantity increases proportionally with~$γ$, while the learned feedback matrix $W_r$ remains bounded and becomes more structured at moderate gains. Critically, a stable reflective band emerges around $γ\approx 0.10-0.20$, where internal feedback is maximally expressive yet spectrally stable: IRR rises smoothly, ESRI remains near zero, and RDP exhibits consistent low-frequency cycles. These findings provide quantitative evidence that reflective, thought-like internal processing can arise from a principled balance between feedback amplification and homeostatic regulation, linking modern fast-weight architectures to theories of cortical reentry and recursive cognition.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。