arXiv:2608.20965cs.LG2026-08

用生成事实图统一建模训练、学习与推理的动态过程。

Training, learning and inference: unified dynamics of neural systems

  • 构建生成事实图记录神经系统的演化轨迹。
  • 在四类转换上达到91.43%准确率与91.49%召回率。
  • 适用于理解模型内部机制,适合研究者深入分析。

我们定义原子生成事实 f=(u,tau,omega,z;rho),记录起源、实现变换、具体发生、生成结果及关系角色。这些事实构成生成事实图(GFG),提供可编译的AI原生科学事实基础,保留生成历史。基于GFG建立递归科学流程,分析、干预、重放与验证形成后续循环的事实。使用nanoGPT,建立统一的训练-学习动态:训练是参数优化系统在状态与记忆下的演化,每次实际训练动作进入接收状态并产生由该状态和目标特定更新几何决定的有限振幅非线性函数响应;学习是这些响应对分布式功能支持的持续重组;能力形成、维持、衰退或恢复在目标特定状态与读出边界对比时可观察。三个主坐标——目标边界状态、目标特定更新几何、参数-Adam接收状态——生成一个在后更新输出读取前运行的二阶预测器。在保留测试中,对四类转换实现91.43%准确率与91.49%宏平均召回率。进一步将推理定义为训练-学习动态的冻结投影。组件门控与回滚揭示查询条件支持在训练中形成的因果调用与非加性组合,推导出注意力实现的组织条件。受控反馈表明可能存在双刃强化效应。ResNet/CIFAR-100与扩散模型/CIFAR-10实验确认了接收状态条件响应、持久支持重组及超越nanoGPT的冻结推理投影。

原文摘要 · Abstract (English)

We define an atomic generation fact f=(u,tau,omega,z;rho), recording the origin, realized transformation, concrete occurrence, generated result and relation role. Compiled into a Generation-Fact Graph (GFG), these facts provide an AI-native, compilable scientific fact substrate preserving generation histories. We establish a GFG-based recursive scientific process in which analysis, intervention, replay and validation form facts for later cycles. Using nanoGPT, we establish unified training-learning dynamics. Training is the evolution of a parameter-optimizer system with state and memory: each actual training action enters the receiving state and produces a finite-amplitude nonlinear functional response conditioned by that state and target-specific update geometry. Learning is the persistent reorganization of distributed functional support by these responses; capability formation, maintenance, decline or recovery becomes observable when target-specific states are evaluated against their readout boundaries. Three primary coordinates - target-boundary state, target-specific update geometry and parameter-Adam receiving state - yield a second-order predictor operating before post-update outputs are read. On held-out runs, it achieved 91.43% accuracy and 91.49% macro-averaged recall across four transitions. We further establish inference as a frozen projection of training-learning dynamics. Component gating and rollback show causal recruitment and non-additive combination of query-conditioned support formed during training, deriving organizational conditions realized by Attention. Controlled feedback indicates possible double-edged reinforcement effects. ResNet/CIFAR-100 and diffusion/CIFAR-10 experiments confirm receiving-state-conditioned responses, persistent support reorganization and frozen inference projection beyond nanoGPT.

神经动力学训练机制推理建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。