arXiv:2609.07859cs.RO2026-09

统一多模态遥操作框架,提升机器人柔顺全身操作的稳定性和数据质量

M3-Tele: A Unified Multimodal Teleoperational Framework for Compliant Whole-Body Mobile Manipulation

论文配图:M3-Tele: A Unified Multimodal Teleoperational Framework for Compliant Whole-Body Mobile Manipulation
图 1 · 摘自论文原文
  • 融合视觉、触觉、力觉与本体感知,实现多模态数据同步采集
  • 力跟踪误差降至0.346N,接触丢失减少至0.02次/次,触觉形变误差降低65%
  • 适合需要高精度物理交互的移动操作任务研究与应用

高效执行接触密集型任务需无缝整合全身协调与物理柔顺控制。然而,现有遥操作与数据采集框架常忽略多模态感知与全身协同的联合考虑,影响示范数据的质量与下游策略学习效果。本文提出 extbf{M3-Tele}:一种面向柔顺全身移动操作的统一多模态遥操作系统,可在任务执行中实现稳定物理交互,并同步采集对齐的视觉、触觉、力觉与本体感知数据。大量实验表明,该框架显著提升接触密集型遥操作性能:力跟踪误差从4.132 N降至0.346 N,接触丢失由2.46次/次降至0.02次/次,触觉形变误差降低65%。四项移动操作任务的用户研究表明系统可靠且易用。此外,扩散策略实验验证了触觉与力觉联合感知的价值。

原文摘要 · Abstract (English)

Executing contact-rich tasks efficiently requires the seamless integration of whole-body coordination and physical compliance regulation. However, existing teleoperation and data-collection frameworks often overlook the joint consideration of multimodal perception and coordinated whole-body operation. This limitation can reduce the efficiency and quality of demonstration collection, thereby affecting the effectiveness of downstream policy learning. In this work, we present \textbf{M3-Tele}: A Unified \underline{M}ultimodal \underline{Tele}operational Framework for Compliant Whole-Body \underline{M}obile \underline{M}anipulation, enabling stable physical interaction and capturing aligned visual, tactile, force, and proprioceptive observations during task execution. Extensive experiments demonstrate that the proposed framework significantly improves contact-rich teleoperation performance. The proposed controller reduces the force tracking error from 4.132~N to 0.346~N, the contact loss from 2.46 to 0.02 events per trial and the tactile deformation error by 65\%. User studies across four mobile manipulation tasks also verify the reliability and usability of the proposed system. Furthermore, Diffusion Policy experiments highlight the value of joint tactile and force sensing.

遥操作多模态感知柔顺控制移动操作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。