arXiv:2606.25295cs.RO2026-06

用扩散模型实时预测动态物体抓取轨迹,提升机器人移动操作能力

DynaMOMA: Instantaneous Prediction of Grasp Poses for Mobile Manipulation of Dynamic Objects

论文配图:DynaMOMA: Instantaneous Prediction of Grasp Poses for Mobile Manipulation of Dynamic Objects
图 1 · 摘自论文原文
  • 基于锚点扩散模型生成连续短时抓取轨迹
  • 在模拟环境中实现多种动态物体抓取任务的高成功率
  • 适合需要实时响应的移动机器人操作场景

移动操作是机器人领域的基础任务,近年来快速发展,使机器人能够在复杂环境中导航、伸展并交互。然而,对动态物体的移动操作仍极具挑战性,因机器人需协调移动基座与机械臂,并适应目标姿态的持续变化。核心难点在于从动态观测中预测时间一致的短时抓取轨迹。本文提出 ours{},一个将瞬时抓取轨迹预测与全身控制策略耦合的动态移动操作框架。其预测器采用基于锚点的扩散模型,根据历史观测生成时间上一致的短时抓取轨迹;预测轨迹被编码为紧凑特征,输入全身体强化学习策略,以控制移动操作机器人完成动态抓取。我们进一步引入一种前瞻引导奖励,通过自适应地将目标从当前抓取观测移至瞬时预测轨迹,赋予策略前瞻性抓取能力。在 Isaac Gym 模拟环境中大量实验表明,该方法在多样化设置和多种抓取指标下均表现优异。此外,预测模块与策略在真实世界实验中展现出强泛化能力。

原文摘要 · Abstract (English)

Mobile manipulation is a fundamental robotics task and has advanced rapidly in recent years, enabling robots to navigate, reach, and interact with objects in complex environments. However, mobile manipulation of dynamic objects remains highly challenging, as robots must coordinate the mobile base and arm while adapting to continuously evolving target poses. A key challenge lies in predicting temporally consistent short-horizon grasp trajectories from dynamic observations. In this work, we propose \ours{}, a dynamic mobile manipulation framework that couples instantaneous grasp trajectory prediction with whole-body control policy. Our predictor uses an anchor-based diffusion model to generate temporally consistent short-horizon grasp trajectories conditioned on historical observations. The predicted trajectories are then encoded as compact features and fed to a whole-body reinforcement learning policy, which controls the mobile manipulator for dynamic grasping. We further introduce a anticipation-guided reward that equips the policy with an anticipatory grasping horizon by adaptively shifting the target from the current grasp observation to the instantaneously predicted grasp trajectory. Through extensive experiments in Isaac Gym simulation, we show that our method achieves strong performance in mobile manipulation of dynamic objects across diverse settings and grasping metrics. Furthermore, our predictor and policy demonstrate strong generalizability in real-world experiments.

移动操作动态抓取扩散模型强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。