3D绳子动态操控难?新模拟框架+物理感知扩散策略来解决
Dynamic Manipulation of Deformable Objects in 3D: Simulation, Benchmark and Learning Strategy
- 基于降阶动力学构建紧凑状态表示,缓解数据稀缺问题
- 在真实3D绳子任务中实现高精度与强鲁棒性操控,成功率显著提升
- 适合做复杂柔性体操控的算法研究者和机器人开发者参考
目标导向的动态操控因系统动力学复杂和任务约束严格而极具挑战性,尤其在高自由度、欠驱动的柔体场景中。现有方法多简化为低速或二维设置,难以应用于真实3D任务。本文以3D绳子操控为例,提出一种基于降阶动力学的新型仿真框架与基准测试集,实现紧凑的状态表示并促进高效策略学习。在此基础上,提出动态信息扩散策略(DIDP),结合模仿预训练与物理信息引导的测试时自适应。首先设计扩散策略,在降阶空间中学习逆动力学,使模仿学习超越简单数据拟合,捕捉物理本质;其次提出物理信息引导的测试时适配机制,对扩散过程施加运动学边界条件与结构化动力学先验,确保执行的一致性与可靠性。大量实验验证了该方法在准确性与鲁棒性上的优异表现。
原文摘要 · Abstract (English)
Goal-conditioned dynamic manipulation is inherently challenging due to complex system dynamics and stringent task constraints, particularly in deformable object scenarios characterized by high degrees of freedom and underactuation. Prior methods often simplify the problem to low-speed or 2D settings, limiting their applicability to real-world 3D tasks. In this work, we explore 3D goal-conditioned rope manipulation as a representative challenge. To mitigate data scarcity, we introduce a novel simulation framework and benchmark grounded in reduced-order dynamics, which enables compact state representation and facilitates efficient policy learning. Building on this, we propose Dynamics Informed Diffusion Policy (DIDP), a framework that integrates imitation pretraining with physics-informed test-time adaptation. First, we design a diffusion policy that learns inverse dynamics within the reduced-order space, enabling imitation learning to move beyond naïve data fitting and capture the underlying physical structure. Second, we propose a physics-informed test-time adaptation scheme that imposes kinematic boundary conditions and structured dynamics priors on the diffusion process, ensuring consistency and reliability in manipulation execution. Extensive experiments validate the proposed approach, demonstrating strong performance in terms of accuracy and robustness in the learned policy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。