arXiv:2511.02091cs.LGcs.AI2025-11

提出世界模型的自然构建模块,兼顾可解释性与智能决策能力。

Natural Building Blocks for Structured World Models: Theory, Evidence, and Scaling

  • 用隐马尔可夫与切换线性系统做核心模块,分层组合建模离散与连续过程。
  • 在像素级规划和多模态生成任务中性能媲美神经网络,且模型可解释。
  • 适合追求可解释性与可控性的机器人、强化学习研究者使用。

世界建模领域碎片化严重,研究者常设计独立架构而难以复用。本文提出基于基本随机过程的自然构建模块框架:离散过程(逻辑、符号)与连续过程(物理、动态),通过层级组合构成世界模型。以隐马尔可夫模型(HMM)和切换线性动态系统(sLDS)为离散与连续建模基础,加入动作后可扩展为部分可观测马尔可夫决策过程(POMDP)与受控sLDS。该模块化方法统一支持被动建模(生成、预测)与主动控制(规划、决策)。通过固定因果结构并仅搜索四个深度参数,避免传统结构学习中的组合爆炸。在多模态生成(被动)与像素级规划(主动)任务中表现良好,性能可比神经方法,同时保持可解释性。当前核心挑战是可扩展的联合结构-参数学习;现有方法通过增量式生长结构与参数来规避,但扩展性受限。若解决,这些自然构建模块或可成为世界建模的基础设施,类比深度学习中的标准化层。

原文摘要 · Abstract (English)

The field of world modeling is fragmented, with researchers developing bespoke architectures that rarely build upon each other. We propose a framework that specifies the natural building blocks for structured world models based on the fundamental stochastic processes that any world model must capture: discrete processes (logic, symbols) and continuous processes (physics, dynamics); the world model is then defined by the hierarchical composition of these building blocks. We examine Hidden Markov Models (HMMs) and switching linear dynamical systems (sLDS) as natural building blocks for discrete and continuous modeling--which become partially-observable Markov decision processes (POMDPs) and controlled sLDS when augmented with actions. This modular approach supports both passive modeling (generation, forecasting) and active control (planning, decision-making) within the same architecture. We avoid the combinatorial explosion of traditional structure learning by largely fixing the causal architecture and searching over only four depth parameters. We review practical expressiveness through multimodal generative modeling (passive) and planning from pixels (active), with performance competitive to neural approaches while maintaining interpretability. The core outstanding challenge is scalable joint structure-parameter learning; current methods finesse this by cleverly growing structure and parameters incrementally, but are limited in their scalability. If solved, these natural building blocks could provide foundational infrastructure for world modeling, analogous to how standardized layers enabled progress in deep learning.

世界模型可解释建模结构学习强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。