arXiv:2605.18303cs.LGcs.AI2026-05被引 1

用物理守恒定律约束生成模型,让仿真更真实高效。

PH-Dreamer: A Physics-Driven World Model via Port-Hamiltonian Generative Dynamics

论文配图:PH-Dreamer: A Physics-Driven World Model via Port-Hamiltonian Generative Dynamics
图 1 · 摘自论文原文
  • 基于泊松-哈密顿框架建模能量流动与耗散,强制隐空间具物理结构。
  • 在视觉控制任务中实现更高回报,且想象与真实奖励对齐更紧密。
  • 适合追求物理真实性与能效的强化学习研究者使用。

基于循环状态空间的世界模型虽能高效进行隐空间想象,但缺乏物理结构,导致动态违反守恒与耗散原理。本文提出统一的泊松-哈密顿(Port-Hamiltonian)框架,通过三个协同机制解决该问题:首先,将隐式物理先验嵌入循环转移过程,将投影隐状态演化建模为受控能量路由,引导相空间趋向紧凑且物理一致的表示;其次,构建一种运动感知能量世界模型,从本体感知观测中估计哈密顿量与功率平衡,提供明确的热力学推理信号;第三,利用能量梯度设计能量引导的演员-评论家算法,通过拉格朗日乘子正则化策略优化,趋向更低能量与更平滑控制。在多个视觉控制基准上,该方法不仅获得更优渐近回报,还提升了内部模拟器保真度,使想象与真实奖励之间的对齐更紧密、方差更低,同时降低隐空间体积4.18%-8.41%,能耗最高减少7.80%,均方加加速度(jerk)最多下降9.38%。

原文摘要 · Abstract (English)

World models built on recurrent state space architectures enable efficient latent imagination, yet remain physically unstructured, producing dynamics that violate conservation and dissipative principles. We introduce a unified Port-Hamiltonian framework that remedies this through three synergistic mechanisms. First, we embed implicit physical priors into recurrent transitions by modeling projected latent evolution as action controlled energy routing governed by flow and dissipation, biasing the projected PH phase space toward a more compact and physically structured representation. Second, we develop a kinematics aware energy world model that estimates the Hamiltonian and power balance from proprioceptive observations, providing an explicit physical signal for thermodynamic reasoning. Third, leveraging these energy gradients, we establish an energy guided Actor-Critic that uses Lagrangian multipliers to regularize policy optimization toward lower energy and smoother control. Across visual control benchmarks, this paradigm not only attains superior asymptotic returns but also elevates internal simulator fidelity by establishing a tighter, lower variance alignment between imagined and real rewards, all while reducing latent phase space volume by 4.18-8.41%, energy consumption by up to 7.80%, and mean squared jerk by up to 9.38%.

世界模型物理约束强化学习能量建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。