从不完整观测中学习物理一致的动态系统,提升高维视觉建模可靠性。
Identify Then Project: Contrastive Learning of Latent Dynamics from Partial Observations with Port-Hamiltonian Structure

- 分两阶段:先对比学习隐状态动态,再投影到物理结构子空间。
- 在高维视觉和耗散系统中表现优于单阶段方法,动态保持更稳定。
- 适合需要物理约束的系统建模,如机器人、流体模拟等场景。
当直接在观测空间建模不可行时,尤其在部分观测和高维情况下,识别隐状态表示及其动态至关重要。此时表征学习与物理感知建模紧密耦合。本文研究具有结构化的隐端口-哈密顿系统,涵盖保守与耗散动力学。提出“先识别后投影”的两阶段框架:首先通过对比教师模型从部分观测中学习连续时间隐动态;随后学生模型通过学习的仿射图将教师的表示与动态投影至端口-哈密顿子流形,获得物理一致性实现。作为概念反事实,也考察了联合学习隐识别与结构的单阶段方法,但发现其可靠性较低,从而支持所提两阶段师生框架。理论上证明仿射投影是连接对比隐识别的仿射规范与端口-哈密顿系统的自然桥梁。实证表明,该方法在保留教师动态的同时强制物理结构,在耗散情形与高维视觉设置中显著优于单阶段方案。
原文摘要 · Abstract (English)
Identifying latent state representations and dynamics is essential when direct modeling in observation space is infeasible, particularly under partial and high-dimensional observations. In such settings, representation learning and physics-aware modeling are inherently coupled. We study this problem for latent port-Hamiltonian systems, a structured class encompassing both conservative and dissipative dynamics. We propose a two-stage identify-then-project framework. First, a contrastive teacher learns continuous-time latent dynamics from partial observations. Then, a student projects the identified teacher representation and dynamics onto a port-Hamiltonian submanifold via a learned affine chart, yielding a physically consistent realization. As a conceptual counterfactual, we also consider a single-stage variant that jointly learns latent identification and port-Hamiltonian structure, but find it to be less reliable, motivating the proposed two-stage teacher-student framework. We show theoretically that affine projection is the natural bridge between the affine gauge of contrastive latent identification and the port-Hamiltonian systems. Empirically, we demonstrate that the proposed two-stage approach preserves the teacher's dynamics while enforcing physical structure, and performs more reliably than the single-stage alternative, particularly in dissipative regimes and high-dimensional visual settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。