仅靠身体感觉,机器人就能完成推拉、踢球、抓箱等复杂操作。
Blind Dexterity: Whole-Body Humanoid Manipulation via Pure Proprioception

- 用关节编码器替代视觉和触觉,实现无摄像头的全身操控。
- 在无惯性测量单元情况下仍能稳定行走并精准抓取物体。
- 适合低成本机器人开发,为未来多模态感知打基础。
我们展示了一种基于单位兔G1人形机器人、仅依赖机载本体感受信息(无摄像头、标记物、力矩传感器或触觉传感器)的盲视全身体操控技能。尽管感知极简,训练出的策略在多种不同任务中表现出惊人能力:无需惯性测量单元反馈即可保持抗推稳定性地双足行走;用脚主动拦截足球;通过手柄定位并提起行李箱;以及登上随机放置的滑板。我们认为这些能力源于一个被低估的关键信号:在有目的的柔顺接触下,关节编码器读数随时间演变的方式,实际上构成了一个全身触觉通道。通过生成丰富的接触动作,训练策略主动探测环境;因此,任务相关的物体状态(如姿态)可从短期本体感受历史中逐步解码。我们通过与策略完全独立训练的任务特定状态估计算法揭示了这一信息;其预测误差在发生有效接触后迅速下降。结果表明,基于关节编码器的本体感受,结合现广泛可用的柔顺驱动(商用机器人和低成本电机已普遍支持),已足以构成全身体灵巧操作与交互感知的强大实用基础,是未来更丰富感知层叠的理想起点。
原文摘要 · Abstract (English)
We present blind, whole-body manipulation skills on a Unitree G1 humanoid using only onboard proprioception, without cameras, markers, force-torque, or tactile sensors. Despite this minimal sensing, the trained policies exhibit surprising capability across qualitatively different tasks: push-resilient bipedal walking without IMU feedback, active soccer ball trapping with a foot, seeking and lifting a suitcase by its handle, and mounting a randomly positioned skateboard. We argue that these capabilities arise from a key underappreciated signal: the way the joint encoder readouts evolve under purposeful compliant contact, effectively forming a whole-body tactile channel. By generating contact-rich motions, the trained policies actively probe the environment; as a result, task-relevant object state (e.g., pose) becomes increasingly decodable from short proprioceptive histories. We expose this information using compact task-specific state estimators trained alongside, but fully separately from, the policies; their prediction errors decrease rapidly after informative contact. Our results indicate that joint encoder-based proprioception, combined with compliant actuation (now widely available on commercial robots and low-cost motors) is already a strong, practical substrate for whole-body dexterous manipulation and interactive perception, and therefore a natural foundation on which richer sensing can be layered.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。