让四足机械臂在动态物体抓取中更稳更快,突破传统静态抓取局限。
Whole-Body Coordination for Dynamic Object Grasping with Legged Manipulators
- 用教师-学生框架从有限感知信息推断抓取姿态
- 在复杂动态场景下成功率显著高于基线方法
- 适合物流分拣、人机协作等真实动态任务
带机械臂的四足机器人通过全身协同控制,在非结构化动态环境中具备强机动性和适应性,可用于物体抓取。然而现有研究多聚焦静态目标抓取,忽视动态目标带来的挑战,限制了其在物流分拣和人机协作等动态场景中的应用。为此,我们提出DQ-Bench新基准,系统评估不同目标运动、速度、高度、物体类型及地形复杂度下的动态抓取表现,并配备全面评价指标。基于该基准,我们设计DQ-Net紧凑型师生框架,从有限感知线索中推断抓取配置。训练时,教师网络利用特权信息全局建模目标静态几何与动态运动特性,并集成抓取融合模块,为运动规划提供鲁棒指导;同时设计轻量学生网络,仅使用目标掩码、深度图和本体感知状态,实现双视角时序建模,支持闭环动作输出且不依赖特权数据。在DQ-Bench上的大量实验表明,DQ-Net在多种任务设置下均能实现稳健的动态物体抓取,成功率达基线方法显著提升,响应速度更快。
原文摘要 · Abstract (English)
Quadrupedal robots with manipulators offer strong mobility and adaptability for grasping in unstructured, dynamic environments through coordinated whole-body control. However, existing research has predominantly focused on static-object grasping, neglecting the challenges posed by dynamic targets and thus limiting applicability in dynamic scenarios such as logistics sorting and human-robot collaboration. To address this, we introduce DQ-Bench, a new benchmark that systematically evaluates dynamic grasping across varying object motions, velocities, heights, object types, and terrain complexities, along with comprehensive evaluation metrics. Building upon this benchmark, we propose DQ-Net, a compact teacher-student framework designed to infer grasp configurations from limited perceptual cues. During training, the teacher network leverages privileged information to holistically model both the static geometric properties and dynamic motion characteristics of the target, and integrates a grasp fusion module to deliver robust guidance for motion planning. Concurrently, we design a lightweight student network that performs dual-viewpoint temporal modeling using only the target mask, depth map, and proprioceptive state, enabling closed-loop action outputs without reliance on privileged data. Extensive experiments on DQ-Bench demonstrate that DQ-Net achieves robust dynamic objects grasping across multiple task settings, substantially outperforming baseline methods in both success rate and responsiveness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。