arXiv:2503.16806cs.ROcs.AI2025-03ICCV被引 27

DyWA让机器人在单视角下学会推拉不抓握物体,还能适应不同重量和摩擦。

DyWA: Dynamics-adaptive World Action Model for Generalizable Non-prehensile Manipulation

  • 基于历史轨迹自适应物理变化,统一建模几何、状态与动力学
  • 仿真中成功率提升31.5%,真实场景平均达68%
  • 适合需要跨场景泛化的非抓取操作任务

非抓握操作在处理细长、大型或难以抓取的物体时至关重要。传统规划方法因复杂接触建模而受限,学习方法虽有潜力,但依赖多视角相机与精确位姿追踪,且难以在物体质量或桌面摩擦变化时泛化。为此,我们提出动力学自适应世界动作模型(DyWA),通过联合预测未来状态并根据历史轨迹自适应动态变化,实现更鲁棒的策略学习。该框架统一建模几何、状态、物理与机器人动作,在部分可观测条件下表现优异。相比基线方法,仅用单视点点云观测,仿真中成功率提升31.5%;真实实验中平均成功率达68%,展现出对不同物体形状、摩擦条件的泛化能力,并可在半满水瓶、光滑表面等挑战场景中稳定工作。

原文摘要 · Abstract (English)

Nonprehensile manipulation is crucial for handling objects that are too thin, large, or otherwise ungraspable in unstructured environments. While conventional planning-based approaches struggle with complex contact modeling, learning-based methods have recently emerged as a promising alternative. However, existing learning-based approaches face two major limitations: they heavily rely on multi-view cameras and precise pose tracking, and they fail to generalize across varying physical conditions, such as changes in object mass and table friction. To address these challenges, we propose the Dynamics-Adaptive World Action Model (DyWA), a novel framework that enhances action learning by jointly predicting future states while adapting to dynamics variations based on historical trajectories. By unifying the modeling of geometry, state, physics, and robot actions, DyWA enables more robust policy learning under partial observability. Compared to baselines, our method improves the success rate by 31.5% using only single-view point cloud observations in the simulation. Furthermore, DyWA achieves an average success rate of 68% in real-world experiments, demonstrating its ability to generalize across diverse object geometries, adapt to varying table friction, and robustness in challenging scenarios such as half-filled water bottles and slippery surfaces.

非抓握操作动态自适应单视角感知机器人泛化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。