arXiv:2504.02822cs.AIcs.LG2025-04被引 2

AI科学家在复杂系统下会从哈密顿理论转向拉格朗日理论,且训练结果受种子影响显著。

Do Two AI Scientists Agree?

  • 用哈密顿-拉格朗日神经网络模拟AI科学家,通过多组随机种子训练观察理论演化。
  • 简单系统中学习哈密顿理论,复杂系统引入后转向拉格朗日形式,理论趋于收敛。
  • 训练过程高度依赖随机种子,揭示理论兴衰机制,适用于高维物理问题。

当两个AI模型在同一科学任务上训练时,它们是学习同一理论还是不同理论?历史上,科学理论的存续依赖于实验验证或证伪:数据不足时多种理论共存,数据增多后存活理论空间被压缩。我们发现AI科学家同样遵循这一规律。随着训练数据中系统复杂度提升,AI科学家所学理论趋于收敛,尽管有时形成对应不同理论的独立群体。为此,我们提出MASS框架,即以哈密顿-拉格朗日神经网络作为AI科学家,基于标准物理问题训练,并通过多组随机种子模拟不同配置下的训练过程。研究发现,简单系统中AI倾向于学习哈密顿理论,而引入更复杂系统后则转向拉格朗日表述。同时,训练动态和最终权重存在显著种子依赖性,主导相关理论的兴起与衰落。最后,我们证明该方法不仅可增强可解释性,还可拓展至高维问题。

原文摘要 · Abstract (English)

When two AI models are trained on the same scientific task, do they learn the same theory or two different theories? Throughout history of science, we have witnessed the rise and fall of theories driven by experimental validation or falsification: many theories may co-exist when experimental data is lacking, but the space of survived theories become more constrained with more experimental data becoming available. We show the same story is true for AI scientists. With increasingly more systems provided in training data, AI scientists tend to converge in the theories they learned, although sometimes they form distinct groups corresponding to different theories. To mechanistically interpret what theories AI scientists learn and quantify their agreement, we propose MASS, Hamiltonian-Lagrangian neural networks as AI Scientists, trained on standard problems in physics, aggregating training results across many seeds simulating the different configurations of AI scientists. Our findings suggests for AI scientists switch from learning a Hamiltonian theory in simple setups to a Lagrangian formulation when more complex systems are introduced. We also observe strong seed dependence of the training dynamics and final learned weights, controlling the rise and fall of relevant theories. We finally demonstrate that not only can our neural networks aid interpretability, it can also be applied to higher dimensional problems.

AI科学家理论演化神经网络物理建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。