让视觉与动作动态互促,提升机器人自适应能力
Act to See, See to Act: Diffusion-Driven Perception-Action Interplay for Adaptive Policies
- 用扩散模型建模感知与动作的双向互动机制
- 在仿真和真实机械臂任务中超越现有方法
- 适合研究具身智能与自适应控制的学者
现有模仿学习方法将感知与动作分离,忽略了人类自然具备的感官与行为之间的因果互惠关系。为此,我们提出行动引导扩散策略(DP-AG),通过概率潜空间动态显式建模感知与动作间的动态交互。DP-AG利用变分推断将潜观测编码为高斯后验,并通过行动引导的随机微分方程(SDE)演化潜变量,其中扩散策略噪声预测的向量-雅可比积(VJP)作为结构化随机力驱动潜变量更新。为促进感知与动作间的双向学习,引入循环一致性对比损失,将噪声预测梯度流组织成连贯的感知-动作回路,强制潜变量更新与动作优化之间的一致性转移。理论上,我们推导了行动引导SDE的变分下界,并证明对比目标增强了潜变量与动作轨迹的连续性。实验表明,DP-AG在多个仿真基准和真实世界UR5操控任务中显著优于当前最优方法,为弥合生物适应性与人工策略学习提供了有前景的路径。
原文摘要 · Abstract (English)
Existing imitation learning methods decouple perception and action, which overlooks the causal reciprocity between sensory representations and action execution that humans naturally leverage for adaptive behaviors. To bridge this gap, we introduce Action-Guided Diffusion Policy (DP-AG), a unified representation learning that explicitly models a dynamic interplay between perception and action through probabilistic latent dynamics. DP-AG encodes latent observations into a Gaussian posterior via variational inference and evolves them using an action-guided SDE, where the Vector-Jacobian Product (VJP) of the diffusion policy's noise predictions serves as a structured stochastic force driving latent updates. To promote bidirectional learning between perception and action, we introduce a cycle-consistent contrastive loss that organizes the gradient flow of the noise predictor into a coherent perception-action loop, enforcing mutually consistent transitions in both latent updates and action refinements. Theoretically, we derive a variational lower bound for the action-guided SDE, and prove that the contrastive objective enhances continuity in both latent and action trajectories. Empirically, DP-AG significantly outperforms state-of-the-art methods across simulation benchmarks and real-world UR5 manipulation tasks. As a result, our DP-AG offers a promising step toward bridging biological adaptability and artificial policy learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。