arXiv:2504.11419cs.AIcs.NE2025-04被引 4

让智能体在迷宫中导航,自发形成空间认知模型。

Embodied World Models Emerge from Navigational Task in Open-Ended Environments

  • 通过稀疏奖励训练智能体自主探索迷宫,不依赖预设地图。
  • 在未见过的迷宫中路径接近最优,表明内部存在空间表征。
  • 神经与行为空间线性对齐,证明身体-感知-动作协同催生世界模型。

在部分可观测环境中进行空间推理,传统方法多采用被动预测模型。但具身认知理论认为,真正有用的认知表征需感知与行动紧密耦合。本文研究一个循环智能体,仅通过稀疏奖励学习解决程序生成的平面迷宫问题,是否能自发内化方向、距离和障碍布局等度量概念。训练后,该智能体在未见迷宫中始终生成近似最优路径,暗示其具备潜在的空间模型。我们将其封闭的智体-环境回路视为混合动力系统,识别出状态空间中的稳定极限环,并用岭表示(Ridge Representation)将完整轨迹嵌入共同度量空间。典型相关分析揭示神经与行为流形之间稳健的线性对齐;对关键神经维度施加定向扰动会显著降低导航性能。这些动态、表征与因果证据共同表明:持续的感官-运动交互足以促使紧凑、具身的世界模型自发涌现,为可解释、可迁移的导航策略提供了原则性路径。

原文摘要 · Abstract (English)

Spatial reasoning in partially observable environments has often been approached through passive predictive models, yet theories of embodied cognition suggest that genuinely useful representations arise only when perception is tightly coupled to action. Here we ask whether a recurrent agent, trained solely by sparse rewards to solve procedurally generated planar mazes, can autonomously internalize metric concepts such as direction, distance and obstacle layout. After training, the agent consistently produces near-optimal paths in unseen mazes, behavior that hints at an underlying spatial model. To probe this possibility, we cast the closed agent-environment loop as a hybrid dynamical system, identify stable limit cycles in its state space, and characterize behavior with a Ridge Representation that embeds whole trajectories into a common metric space. Canonical correlation analysis exposes a robust linear alignment between neural and behavioral manifolds, while targeted perturbations of the most informative neural dimensions sharply degrade navigation performance. Taken together, these dynamical, representational, and causal signatures show that sustained sensorimotor interaction is sufficient for the spontaneous emergence of compact, embodied world models, providing a principled path toward interpretable and transferable navigation policies.

具身智能空间认知世界模型强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。