arXiv:2511.02097cs.ROcs.CV2025-11综述被引 18

梳理机器人操作中世界模型的核心能力与实现路径

A Step Toward World Models: A Survey on Robotic Manipulation

  • 从操作任务出发,提炼世界模型的感知、预测与控制功能
  • 识别出动态建模与不确定性处理是核心挑战
  • 适合关注具身智能与通用机器人系统的研究者

自主智能体正面临在复杂、动态且不确定环境中执行操作、导航和决策等任务的挑战。要实现这些能力,智能体需理解环境的内在机制与动态规律,而非仅依赖反应式控制或简单状态复现。这推动了世界模型的发展——即作为对环境状态、动态规律进行编码,并支持预测、规划与推理的内部表征。尽管关注度持续上升,世界模型的定义、范围、架构及关键能力仍不明确。本文不拘泥于固定定义或仅限于被标记为‘世界模型’的方法,而是通过机器人操作领域的研究综述,分析具备世界模型核心能力的方法。我们探讨其在感知、预测与控制中的作用,识别关键挑战与解决方案,并提炼出完整世界模型应具备的核心组件、能力和功能。基于此分析,旨在推动面向通用性与实用性的机器人世界模型进一步发展。

原文摘要 · Abstract (English)

Autonomous agents are increasingly expected to operate in complex, dynamic, and uncertain environments, performing tasks such as manipulation, navigation, and decision-making. Achieving these capabilities requires agents to understand the underlying mechanisms and dynamics of the world, moving beyond reactive control or simple replication of observed states. This motivates the development of world models as internal representations that encode environmental states, capture dynamics, and support prediction, planning, and reasoning. Despite growing interest, the definition, scope, architectures, and essential capabilities of world models remain ambiguous. In this survey, we go beyond prescribing a fixed definition and limiting our scope to methods explicitly labeled as world models. Instead, we examine approaches that exhibit the core capabilities of world models through a review of methods in robotic manipulation. We analyze their roles across perception, prediction, and control, identify key challenges and solutions, and distill the core components, capabilities, and functions that a fully realized world model should possess. Building on this analysis, we aim to motivate further development toward generalizable and practical world models for robotics.

世界模型机器人操作具身智能认知建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。