arXiv:2506.03703cs.LGcond-mat.dis-nn2025-06被引 5

让大模型在临界点学习,用极少示例解决复杂物理符号问题。

Learning-at-Criticality in Large Language Models for Quantum Field Theory and Beyond

  • 通过强化学习将大模型调至临界状态,实现小样本下的最优泛化。
  • 仅用一个示例训练的模型即能完成七进制七位数加法,展现强推理能力。
  • 适合解决数据稀缺的高阶物理符号任务,如量子场论中的马苏巴里求和。

基础物理常面临符号复杂、示范极少或缺乏明确规则的问题。尽管人工智能有潜力,但其对大规模数据的依赖限制了在信息稀缺前沿的应用。我们提出临界学习(LaC),一种将大语言模型(LLMs)调至尖锐学习相变点的强化学习方法,以应对信息稀缺。在此相变点,模型能从极少量数据中实现最佳泛化,例如完成7位数的七进制加法——一项对非平凡算术推理的测试。为揭示该峰值机制,我们构建了一个最小概念网络模型(CoNet),用于捕捉大模型连接词元的本质。该模型仅用一个示例训练,同样经历尖锐学习相变,表现出二级相变特征,如解路径长度呈幂律分布。在临界点,系统最大化一种‘临界思维模式’,这得益于底层的无标度探索。表明大模型通过在临界点运行,借助这种探索动态提取潜在操作规律。我们在量子场论中验证了LaC:一个80亿参数的模型,仅用少数马苏巴里求和示例经LaC调至临界点后,能解决未见过的高阶问题,显著优于远更大规模的模型。因此,LaC利用物理中的临界现象,赋能人工智能应对基础物理中的复杂、低数据挑战。

原文摘要 · Abstract (English)

Fundamental physics often confronts complex symbolic problems with few guiding exemplars or established principles. While artificial intelligence (AI) offers promise, its typical need for vast datasets to learn from hinders its use in these information-scarce frontiers. We introduce learning at criticality (LaC), a reinforcement learning (RL) scheme that tunes Large Language Models (LLMs) to a sharp learning transition, addressing this information scarcity. At this transition, LLMs achieve peak generalization from minimal data, exemplified by 7-digit base-7 addition -- a test of nontrivial arithmetic reasoning. To elucidate this peak, we analyze a minimal concept-network model (CoNet) designed to capture the essence of how LLMs might link tokens. Trained on a single exemplar, this model also undergoes a sharp learning transition. This transition exhibits hallmarks of a second-order phase transition, notably power-law distributed solution path lengths. At this critical point, the system maximizes a ``critical thinking pattern" crucial for generalization, enabled by the underlying scale-free exploration. This suggests LLMs reach peak performance by operating at criticality, where such explorative dynamics enable the extraction of underlying operational rules. We demonstrate LaC in quantum field theory: an 8B-parameter LLM, tuned to its critical point by LaC using a few exemplars of symbolic Matsubara sums, solves unseen, higher-order problems, significantly outperforming far larger models. LaC thus leverages critical phenomena, a physical principle, to empower AI for complex, data-sparse challenges in fundamental physics.

大模型临界学习量子场论小样本推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。