arXiv:2412.12870cs.LG2024-12被引 4

让世界模型的内部表示可解释为真实物理量,提升预测可靠性。

Physically Interpretable World Models via Weakly Supervised Representation Learning

  • 用弱监督约束潜变量与物理量对齐,结合已知物理方程建模演化
  • 在三个任务中实现长期预测,准确恢复系统参数
  • 适合需要安全可靠推理的机器人与控制系统场景

从高维感官观测中学习预测模型是网络物理系统的基础,但标准世界模型学到的潜表示缺乏物理可解释性,限制了其可靠性、泛化性和在安全关键任务中的应用。本文提出物理可解释世界模型(PIWM),通过部分已知的物理动力学约束潜变量演化,使其满足两个互补性质:(i) 潜状态对应有意义的物理变量;(ii) 其时间演化遵循物理一致的动力学。为避免依赖真实物理标注,PIWM采用基于分布的弱监督,自然捕捉现实感知流程中的状态不确定性。架构融合基于VQ的视觉编码器、基于Transformer的物理编码器和基于已知物理方程的可学习动力学模型。在三个案例研究(Cart Pole、Lunar Lander、Donkey Car)中,PIWM实现了精确的长时序预测,恢复了真实系统参数,并显著优于纯数据驱动模型的物理一致性。结果表明,仅通过图像与弱监督即可学习出物理可解释的世界模型。

原文摘要 · Abstract (English)

Learning predictive models from high-dimensional sensory observations is fundamental for cyber-physical systems, yet the latent representations learned by standard world models lack physical interpretability. This limits their reliability, generalizability, and applicability to safety-critical tasks. We introduce Physically Interpretable World Models (PIWM), a framework that aligns latent representations with real-world physical quantities and constrains their evolution through partially known physical dynamics. Physical interpretability in PIWM is defined by two complementary properties: (i) the learned latent state corresponds to meaningful physical variables, and (ii) its temporal evolution follows physically consistent dynamics. To achieve this without requiring ground-truth physical annotations, PIWM employs weak distribution-based supervision that captures state uncertainty naturally arising from real-world sensing pipelines. The architecture integrates a VQ-based visual encoder, a transformer-based physical encoder, and a learnable dynamics model grounded in known physical equations. Across three case studies (Cart Pole, Lunar Lander, and Donkey Car), PIWM achieves accurate long-horizon prediction, recovers true system parameters, and significantly improves physical grounding over purely data-driven models. These results demonstrate the feasibility and advantages of learning physically interpretable world models directly from images under weak supervision.

世界模型物理可解释弱监督机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。