通过多阶段参数估计,让轮式人形机器人更精准地远程操控重物。
Whole-Body Bilateral Teleoperation with Multi-Stage Object Parameter Estimation for Wheeled Humanoid Locomanipulation
- 分三步在线估算物体质量、质心和惯性,提升估计效率。
- 在真实机器人上实现实时控制,能搬运自身体重1/3的重物。
- 适合需要高精度远程操作的工业或救援场景。
本文提出一种面向轮式人形机器人局部操纵的全身双向遥操作框架,融合了在线多阶段物体惯性参数估计模块。该模块分阶段集成视觉尺寸估计、基于大视觉语言模型(VLM)的初始参数猜测以及解耦的分层采样策略。视觉尺寸估计与VLM先验为物体惯性参数提供强初始猜测,显著缩小采样搜索空间,提升整体估计速度。分层策略先估计质量与质心,再根据物体尺寸推导惯性,确保物理合理性;解耦多假设方案增强对VLM先验误差的鲁棒性。估计器与高保真仿真及硬件并行运行,支持实时在线更新。估计参数用于调整机器人平衡点,使操作者可专注运动与操作。该集成提升了动态同步下的触觉反馈质量,实现更动态的全身遥操作。通过补偿物体动力学,框架同时改善操纵跟踪性能并保持柔顺行为。我们在定制轮式人形机器人(带机械臂)和人机接口上验证系统,成功实现实时执行举、运、放任务,负载约等于机器人本体重量的三分之一。
原文摘要 · Abstract (English)
This paper presents an object-aware whole-body bilateral teleoperation framework for wheeled humanoid loco-manipulation. This framework combines whole-body bilateral teleoperation with an online multi-stage object inertial parameter estimation module, which is the core technical contribution of this work. The multi-stage process sequentially integrates a vision-based object size estimator, an initial parameter guess generated by a large vision-language model (VLM), and a decoupled hierarchical sampling strategy. The visual size estimate and VLM prior offer a strong initial guess of the object's inertial parameters, significantly reducing the search space for sampling-based refinement and improving the overall estimation speed. A hierarchical strategy first estimates mass and center of mass, then infers inertia from object size to ensure physically feasible parameters, while a decoupled multi-hypothesis scheme enhances robustness to VLM prior errors. Our estimator operates in parallel with high-fidelity simulation and hardware, enabling real-time online updates. The estimated parameters are then used to update the wheeled humanoid's equilibrium point, allowing the operator to focus more on locomotion and manipulation. This integration improves the haptic force feedback for dynamic synchronization, enabling more dynamic whole-body teleoperation. By compensating for object dynamics using the estimated parameters, the framework also improves manipulation tracking while preserving compliant behavior. We validate the system on a customized wheeled humanoid with a robotic gripper and human-machine interface, demonstrating real-time execution of lifting, delivering, and releasing tasks with a payload weighing approximately one-third of the robot's body weight.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。