arXiv:2607.16256cs.LGcs.AI2026-07

让机器像做梦一样重组跨领域知识,激发真正发现。

Discovery by Dreaming: Cross-Domain Recombination in Artificial Memory

论文配图:Discovery by Dreaming: Cross-Domain Recombination in Artificial Memory
图 1 · 摘自论文原文
  • 模拟梦境中跨域重组机制,让模型在离线阶段重新组合不同领域知识。
  • 符号系统实现85.7%跨域连接率,比基线提升21个百分点;神经网络在数学推理上提升14.5个百分点。
  • 该方法能真实产生新发现,适合需要创造性推理的AI系统设计者。

梦境将从未相遇的人、地、时拼接在一起。神经科学表明这种重组并非噪声,而是推动洞察与创造性发现的功能。这重塑了记忆巩固的意义:其可衡量的价值不在于防止遗忘,而在于重组尚未共现的经验。我们通过隔离重组重放机制,在两种架构无关的系统中验证:一个基于LoRA微调的管道(DREAMS)和一个重放结构化知识对象的符号引擎(SAPIENCE)。两者均得出一致结论:跨领域巩固创造价值,而同领域重复无效。符号系统在85.7%的案例中发现新跨域关联,较基线提升21个百分点;神经系统整体提升5.64个百分点,而在需跨域迁移的任务(如GSM8K上的未见数学推理)中,提升达14.5个百分点。该效应是权重的固有属性,非提示伪影——将相同材料以上下文方式输入671B参数模型反而逆转增益。我们用5万篇真实论文验证该预测,并提出可证伪的海马记录假设,以区分重组与重复。最终,该原则具有通用性,可追踪大规模真实发现。阅读文献仅教会模型回忆,而生成发现需独立的离线重组阶段——即计算层面的‘做梦’。巩固不是为了记住,而是为了发现。

原文摘要 · Abstract (English)

Dreams splice together people, places, and times that never met. Neuroscience suggests this recombination is not noise, but a function driving insight and creative discovery. This reframes memory consolidation: rather than merely defending against forgetting, its measurable value lies in recombining knowledge across experiences that have not yet co-occurred. We test this directly by isolating the recombinatory-replay mechanism and implementing it in two architecturally unrelated systems: a LoRA fine-tuning pipeline (DREAMS) and a symbolic engine replaying structured knowledge objects (SAPIENCE). Both systems converge on the same finding: cross-domain consolidation creates value, while within-domain rehearsal does not. The symbolic arm surfaces novel cross-domain connections at 85.7%, a +21 percentage point (pp) gain over baseline. The neural arm improves overall by +5.64 pp, but on subtasks explicitly requiring cross-domain transfer (like unseen math reasoning on GSM8K), gains reach +14.5 pp. This effect is a genuine property of the weights--not a prompt artifact--as prepending the same material in-context to a 671B-parameter model actually reverses the gain. We validate this prediction against documented discoveries across 50,000 real papers and state a falsifiable hippocampal-recording prediction to distinguish recombination from rehearsal. Ultimately, this principle is substrate-general, tracking real discovery at scale. Reading the literature teaches a model to recall what it has seen, but producing discovery requires a separate offline phase that recombines knowledge across domains--the computational analog of dreaming. Consolidation is not for remembering, but for discovering.

机器发现跨域推理梦境机制知识重组

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。