arXiv:2509.14980cs.ROcs.AI2025-09被引 4

多视角扩散策略+抗奇异鲁棒控制,提升移动操作在复杂环境中的成功率。

M4Diffuser: Multi-View Diffusion Policy with Manipulability-Aware Control for Robust Mobile Manipulation

  • 融合多视角视觉与本体感知,生成全局任务目标
  • 实测成功率达7%-56%提升,碰撞减少3%-31%
  • 适合需要强泛化能力的复杂场景移动操作

移动操作需协同控制移动底盘与机械臂,同时感知全局场景与细粒度物体信息。现有单视角方法因视野有限、探索与泛化能力不足,在非结构化环境中表现不佳。传统控制器虽稳定,但在奇异点附近效率低、易失效。为此,我们提出M4Diffuser,一种结合多视角扩散策略与新型简化可操作性感知二次规划(ReM-QP)控制器的混合框架。扩散策略利用本体状态与互补相机视角,融合近距物体细节与全局场景上下文,生成世界坐标系下的任务相关末端执行器目标。这些高层目标由ReM-QP控制器执行,通过消除松弛变量提升计算效率,并引入可操作性感知偏好以增强奇异点附近的鲁棒性。仿真与真实环境的综合实验表明,相比基线方法,M4Diffuser成功率提升7%至56%,碰撞减少3%至31%。该方法实现了平滑的整体身体协调与对未见任务的强泛化能力,为非结构化环境中可靠移动操作铺平道路。演示与补充材料详见项目网站https://sites.google.com/view/m4diffuser。

原文摘要 · Abstract (English)

Mobile manipulation requires the coordinated control of a mobile base and a robotic arm while simultaneously perceiving both global scene context and fine-grained object details. Existing single-view approaches often fail in unstructured environments due to limited fields of view, exploration, and generalization abilities. Moreover, classical controllers, although stable, struggle with efficiency and manipulability near singularities. To address these challenges, we propose M4Diffuser, a hybrid framework that integrates a Multi-View Diffusion Policy with a novel Reduced and Manipulability-aware QP (ReM-QP) controller for mobile manipulation. The diffusion policy leverages proprioceptive states and complementary camera perspectives with both close-range object details and global scene context to generate task-relevant end-effector goals in the world frame. These high-level goals are then executed by the ReM-QP controller, which eliminates slack variables for computational efficiency and incorporates manipulability-aware preferences for robustness near singularities. Comprehensive experiments in simulation and real-world environments show that M4Diffuser achieves 7 to 56 percent higher success rates and reduces collisions by 3 to 31 percent over baselines. Our approach demonstrates robust performance for smooth whole-body coordination, and strong generalization to unseen tasks, paving the way for reliable mobile manipulation in unstructured environments. Details of the demo and supplemental material are available on our project website https://sites.google.com/view/m4diffuser.

移动操作扩散模型多视角机器人控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。