arXiv:2608.15976cs.LG2026-08被引 2

揭示学习系统隐藏动态,用纤维指纹预测未来训练响应

Fiber Fingerprints of Hidden Learning-State Dynamics

  • 提出纤维指纹概念,基于当前行为等价类预测未来学习响应
  • 实证发现冻结模型中存在可见、复用与不可约新三类响应分量
  • 适用于理解大模型微调中的隐藏状态机制,适合研究者参考

学习系统可能处于在所有显式行为观测下无法区分的执行状态,但对未来训练的响应却不同。本文通过纤维指纹形式化这一现象:在当前行为等价类上受限的受控未来学习响应规律。前缀兼容的有限探测器诱导出预测商函子、类似Nerode的最小递归充分表示以及无须假设光滑性、可逆性、有限秩或流形结构的规范集级预测纤维。在显式有限维希尔伯特实现下,响应分解为可见、可见模式复用和不可约新增三个部分;历史可达性桥仅保留由自然训练历史生成的差异。条件机制结果进一步揭示图-霍奇时间分解、均方根尺度为√p·η³/²的规则切换类及有限尺度修正项,并找到精确的Adam动量截面——其即时自适应场恒定,而共同未来梯度可揭示隐藏动量差异。对Qwen2.5-7B和Mistral-7B-v0.3的冻结Transformer-LoRA-AdamW实验支持局部作用主干、更长视野首次返回非闭包性,以及输出范围复用下的新可见相对补全与低秩不可约部分。更强结论受限于预注册的负或混合结果:重锚定传输在测量底限以上未解决;严格有限网格霍奇-3/2联合虽有前景收缩但未满足;Qwen在冻结原始动量图中未建立可访问性;Mistral的揭示依赖未来上下文而非银行不变性。在此支持、尺度、度量与上下文限定范围内,当前行为不足以表征未来学习。

原文摘要 · Abstract (English)

A learning system can occupy execution states that are indistinguishable under every declared present-behavior readout yet respond differently to future training. We formalize this through fiber fingerprints: controlled future-learning response laws restricted to present-behavior equivalence classes. Prefix-compatible finite probes induce a predictive quotient functor, a Nerode-type minimal recursively sufficient representation, and a canonical set-level predictive fiber without assuming smoothness, reversibility, finite rank, or a manifold. Under an explicit finite-dimensional Hilbert realization, response decomposes into visible, visible-mode-reuse, and irreducible-new sectors; a history-reachability bridge retains only distinctions generated by natural training histories. Conditional mechanism results then identify a graph-Hodge chronology decomposition, a regular switching class with root-mean-square scale $\sqrt{p}η^{3/2}$ and finite-scale corrections, and an exact Adam moment section whose immediate adaptive field is constant while common future gradients can reveal hidden moment differences. Frozen Transformer--LoRA--AdamW studies with Qwen2.5-7B and Mistral-7B-v0.3 support a local action backbone, longer-horizon first-return non-closure, and fresh visible-relative completion with output-range reuse and a low-rank irreducible sector. Stronger claims remain bounded by preregistered negative or mixed results: re-anchored transport is unresolved above its measurement floor; the strict finite-grid Hodge--$3/2$ conjunction is unmet despite prospective contraction; Qwen accessibility is not established in the frozen raw moment chart; and Mistral revelation is future-context dependent rather than bank invariant. Within these support-, scale-, metric-, and context-resolved boundaries, present behavior is not a sufficient statistic for declared future learning.

机器学习动态系统模型分析优化理论

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。