arXiv:2410.03020cs.LGstat.ML2024-10AAAI被引 10

研究神经网络如何解迷宫,发现其推理能力可能只是表面现象。

On Logical Extrapolation for Mazes with Recurrent and Implicit Networks

  • 用多种维度测试迷宫数据,检验模型是否真学会解题算法。
  • 部分RNN看似学会'填死胡同'策略,但整体仍存在错误泛化。
  • 关注模型收敛行为,揭示推理背后的动态机制,适合算法设计者参考。

近期研究表明,某些神经网络架构(尤其是循环神经网络RNN和隐式神经网络INN)具备逻辑外推能力:在简单任务上训练后,能推广到更复杂的实例。本文聚焦于单一任务——迷宫求解,通过多维度调整测试数据(不仅限于迷宫大小),发现已有模型以多种方式失败,部分可预测,部分出人意料。目前尚不确定任何模型是否真正学习了可扩展的迭代算法。但证据显示,某一RNN近似学会了‘死胡同填充’策略。增加训练数据多样性虽缓解部分缺陷,却反而削弱了逻辑外推性能。此外,分析收敛行为表明,显式训练为不动点的模型在泛化时更易收敛,而未训练的模型可能呈现极限环等复杂动态,即使正确解题。结果表明:(i) 逻辑外推并非免于目标误泛化;(ii) 分析外推过程中的动力学行为,或可为设计更优逻辑外推器提供洞见。

原文摘要 · Abstract (English)

Recent work suggests that certain neural network architectures -- particularly recurrent neural networks (RNNs) and implicit neural networks (INNs) -- are capable of logical extrapolation. When trained on easy instances of a task, these networks (henceforth: logical extrapolators) can generalize to more difficult instances. Previous research has hypothesized that logical extrapolators do so by learning a scalable, iterative algorithm for the given task which converges to the solution. We examine this idea more closely in the context of a single task: maze solving. By varying test data along multiple axes -- not just maze size -- we show that models introduced in prior work fail in a variety of ways, some expected and others less so. It remains uncertain whether any of these models has truly learned an algorithm. However, we provide evidence that a certain RNN has approximately learned a form of `deadend-filling'. We show that training these models on more diverse data addresses some failure modes but, paradoxically, does not improve logical extrapolation. We also analyze convergence behavior, and show that models explicitly trained to converge to a fixed point are likely to do so when extrapolating, while models that are not may exhibit more exotic limiting behavior such as limit cycles, even when they correctly solve the problem. Our results (i) show that logical extrapolation is not immune to the problem of goal misgeneralization, and (ii) suggest that analyzing the dynamics of extrapolation may yield insights into designing better logical extrapolators.

神经网络逻辑推理迷宫求解算法学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。