仅用自感知数据实现人形机器人全身接触力估计算法
SixthSense: Task-Agnostic Proprioception-Only Whole-Body Wrench Estimation for Humanoids

- 通过条件流匹配建模本体感知历史,推断接触事件时空分布
- 在站姿、行走和全身运动中实现高精度力估计,无需外部传感器
- 适合需精准力交互的场景,如人机协作与遥操作
人形机器人正大规模进入物理世界,但多数仅擅长表演而缺乏实际任务中的力交互能力。要弥补这一差距,可靠接触感知成为关键。人形机器人外部力矩估计受浮动基动力学和接触位置不确定性的制约。现有解析方法依赖理想假设和难以获取的测量数据,在实际中常不可行。为此,我们提出SixthSense,一种任务无关的全身体感接触力估计算法,仅依赖本体感知与惯性测量单元(IMU)数据。为捕捉非结构化接触输入与不确定运动输出之间的多模态动态,我们采用条件流匹配技术,对本体感知历史进行编码,并估计时空稀疏的接触事件流。SixthSense可作为即插即用的感知模块,应用于碰撞检测、物理人机交互及力反馈遥操作。在站立、行走和全身运动追踪策略下,实验展示了其在多样化行为中的卓越性能。
原文摘要 · Abstract (English)
Humanoid robots are entering our physical world at scale, yet as oversized toys--good at singing and dancing, but short on force-interaction capabilities for practical tasks. Bridging this gap necessitates prioritizing reliable contact perception as a fundamental requirement. Estimating external wrenches in humanoids is complicated by floating-base dynamics and indeterminate contact locations. Existing analytical frameworks require idealistic assumptions and hard-to-obtain measurements, which are often unavailable in practice. To bridge this gap, we propose SixthSense, a task-agnostic approach that infers whole-body contact timing, location, and wrenches from proprioception and IMU data alone. To capture the multi-modal dynamics between unstructured contact inputs and the uncertain motion outputs, we employ conditional flow matching to tokenize proprioceptive histories and estimate a spatiotemporally sparse contact-event flow. SixthSense serves as a plug-and-play perception module for applications including collision detection, physical human-robot interaction, and force-feedback teleoperation. Experiments across standing, walking, and whole-body motion-tracking policies showcased unprecedented performance in diverse behaviors.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。