AI推理变慢源于复杂任务中的混沌陷阱,导致计算路径呈分形结构。
Fractal basins trap latent reasoning

- 通过分析推理过程发现,模型在近似解附近陷入混沌状态
- 任务越难,分形基域越明显,推理时间显著延长
- 适用于研究大模型推理机制或复杂问题求解的学者
推理使人工智能模型能够回溯并修正错误,推动数学定理证明、软件工程和自主任务规划等前沿进展。尽管观察到模型在难题上推理时间更长,但其普遍机制尚不明确。本文揭示,推理模型表现出瞬时混沌,这是难题计算复杂性的物理结果。由此,我们发现多种领先推理模型为具有分形基域的动力系统,且分形性随任务难度上升,在数独、迷宫求解、视觉谜题及数学逻辑等任务中均显现。瞬时混沌源于模型长期被困于鞍点附近,对应于接近正确的尝试解。结果表明,推理延迟是现代人工智能模型面对难题时的必然产物,并将推理轨迹确立为一类新的丰富动力系统。
原文摘要 · Abstract (English)
Reasoning allows artificial intelligence models to revisit and correct their mistakes, enabling recent frontier advances in mathematical theorem solving, software engineering, and autonomous task planning. Reasoning models are widely observed to reason for longer on harder tasks, but the general mechanism responsible for these slowdowns is unknown. Here, we show that reasoning models exhibit transient chaos, a physical consequence of the computational complexity of difficult tasks. As a consequence, we show that diverse leading reasoning models are dynamical systems with fractal basins, with fractality increasing with task difficulty across diverse tasks like Sudoku and maze solving, visual puzzles, and mathematical logic. We show that transient chaos emerges due to reasoning becoming trapped for extended durations near saddle points, which we show correspond to nearly-correct attempted solutions of the underlying problem. Our results show that reasoning slowdowns are an inevitable consequence of problem hardness in modern artificial intelligence models, and establish reasoning traces as a rich new class of dynamical system.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。