提升物体中心表征质量,让世界模型更高效、更鲁棒。
Better Slots, Better Worlds: Representation Quality & Robustness in Object-Centric World Models

- 用无监督指标衡量槽位质量,优化物体中心表征
- 高质量槽位可使规划成功率提升,且无需额外辅助信号
- 在分布外场景中表现更稳定,适合复杂环境下的规划任务
从离线轨迹学习世界模型可支持智能体通过规划完成多种任务。物体中心(OC)表征将场景分解为绑定到物体的若干槽位,被视作提升样本效率和泛化能力的归纳偏置。然而,现有物体中心世界模型(OCWMs)将槽编码器视为既定,仅评估分布内性能,未验证其对规划的实际价值及关键驱动因素。本文在两个维度上对视觉模型预测控制中的OCWM进行受控研究:物体中心表征质量与场景中心模型在分布外下的泛化能力。结果表明:(i) 规划成功率与无监督槽位质量指标(FG-ARI、mBO)正相关,但高槽位质量后收益饱和;(ii) 具有良好绑定槽位时,以往方法依赖的辅助本体感觉输入和掩码归纳偏置变得不再必要;(iii) 在未见分布偏移下,具备高质量槽位的OCWM整体更鲁棒,优于端到端训练的场景中心LeWM,而基于相似冻结预训练特征的DINO-WM仍具竞争力,表明预训练特征是鲁棒性的关键贡献者。
原文摘要 · Abstract (English)
Learning world models from offline trajectories enables agents to accomplish different tasks through planning. Object-centric (OC) representations, which decompose a scene into a set of slots that bind to its objects, have been proposed as an inductive bias for world models that are more sample-efficient and generalize better. Yet prior object-centric world models (OCWMs) take the slot encoder as given and evaluate only in-distribution, leaving open whether the object-centric bias actually delivers for planning and what within the OCWM drives it. We conduct a controlled study of OCWMs for visual model-predictive control along two axes: object-centric representation quality and generalization under distribution shift relative to scene-centric models. We find that (i) planning success correlates positively with unsupervised slot-quality metrics (FG-ARI, mBO), though the gains saturate at high slot quality; (ii) with well-bound slots, the auxiliary proprioception inputs and masking inductive bias that prior methods relied on become unnecessary; and (iii) under unseen distribution shifts, the OCWM with well-bound slots is more robust overall than the end-to-end trained scene-centric LeWM, while DINO-WM, built on similar frozen pretrained features, remains competitive -- pointing to pretrained features as a key contributor to robustness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。