arXiv:2601.04362cs.LGcs.NE2026-01

用振荡神经网络模拟学习,分清醒与睡眠阶段实现稳定记忆。

Phasor Agents: Oscillatory Graphs with Three-Factor Plasticity and Sleep-Staged Learning

  • 用相位图结构建模,通过三因素可塑性更新权重,无需反向传播。
  • 睡眠阶段安全固化记忆,使学习稳定性提升67%,噪声下检索效率达基线4倍。
  • 模拟动物潜伏学习现象,证明模型具备内部认知地图,适合智能体研究。

Phasor Agents 是一类动态系统,其内部状态为相位图:由耦合的 Stuart-Landau 振荡器构成的加权图。每个振荡器是近霍普夫分歧的最小稳定“节律生成器”,被视作抽象计算单元(受生物振荡群体启发,但不声称建模真实神经机制)。振荡器相位表示相对时间一致性(相干性),振幅表示局部增益或活跃度。相对相位结构作为表征媒介;耦合权重通过三因素本地可塑性学习:由稀疏全局调制器门控的易化痕迹,以及振荡时序写入窗口,无需反向传播。振荡底座的核心挑战是稳定性:在线权重更新可能引发全局同步等非理想状态,导致表征多样性崩溃。因此,借鉴突触标记-捕获和睡眠阶段动力学,将清醒标记与离线巩固分离:深度睡眠样门控捕获安全地固化标记变化,而快速眼动(REM)样重播重构并扰动经验以支持规划。一套分阶段实验验证各机制:易化痕迹在延迟调制下仍保信用;压缩进度信号通过时间打乱控制;相位相干检索在噪声下达到扩散基线的4倍;清醒/睡眠分离使相同权重范数预算下稳定学习扩大67%;REM 重播使迷宫成功率提升45.5个百分点;并出现托尔曼式潜伏学习特征——无奖赏探索后立即具备解题能力及绕行优势,符合内部模型存在。代码库与全部数据集开源。

原文摘要 · Abstract (English)

Phasor Agents are dynamical systems whose internal state is a Phasor Graph: a weighted graph of coupled Stuart-Landau oscillators. A Stuart-Landau oscillator is a minimal stable "rhythm generator" (the normal form near a Hopf bifurcation); each oscillator is treated as an abstract computational unit (inspired by, but not claiming to model, biological oscillatory populations). In this interpretation, oscillator phase tracks relative timing (coherence), while amplitude tracks local gain or activity. Relative phase structure serves as a representational medium; coupling weights are learned via three-factor local plasticity - eligibility traces gated by sparse global modulators and oscillation-timed write windows - without backpropagation. A central challenge in oscillatory substrates is stability: online weight updates can drive the network into unwanted regimes (e.g., global synchrony), collapsing representational diversity. We therefore separate wake tagging from offline consolidation, inspired by synaptic tagging-and-capture and sleep-stage dynamics: deep-sleep-like gated capture commits tagged changes safely, while REM-like replay reconstructs and perturbs experience for planning. A staged experiment suite validates each mechanism with ablations and falsifiers: eligibility traces preserve credit under delayed modulation; compression-progress signals pass timestamp-shuffle controls; phase-coherent retrieval reaches 4x diffusive baselines under noise; wake/sleep separation expands stable learning by 67 percent under matched weight-norm budgets; REM replay improves maze success rate by +45.5 percentage points; and a Tolman-style latent-learning signature - immediate competence and detour advantage after unrewarded exploration, consistent with an internal model - emerges from replay (Tolman, 1948). The codebase and all artifacts are open-source.

神经网络记忆睡眠强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。