arXiv:2608.10383cs.RO2026-08中稿 · the 2026 IEEE/RSJ …

单视角输入下实现双臂协同抓取大物体,真实世界稳定有效。

Real-World Cooperative Bimanual Dexterous Grasp of Large Objects from Single-View Observations

论文配图:Real-World Cooperative Bimanual Dexterous Grasp of Large Objects from Single-View Observations
图 1 · 摘自论文原文
  • 基于点云生成双臂关节配置,融合视觉与力觉信息
  • 真实机器人实验成功抓取多种未知形状物体,成功率高
  • 无需完整3D模型,适合实际应用场景

大物体的双臂灵巧抓取是机器人操作中的关键挑战。现有方法多集中于顺序操作,且大多局限于仿真环境。其主要瓶颈在于难以获取完整的3D物体模型,以及生成物理上合理的抓取动作。为此,我们提出一种真实世界的双臂抓取框架:构建包含关节角度、视觉观测和力信号的多模态数据集;设计基于去噪扩散概率模型(DDPM)的模块,从分割后的点云生成关节级抓取配置;采用结合运动规划与在线抓取优化的执行策略,确保物理稳定性和可行性。该方法可从单视角输入合成可执行的双臂抓取动作,降低对完整3D模型的依赖,保障真实场景下的稳定性能。在双臂机器人上的实验表明,对多种未见过的几何形状和姿态物体均取得高成功率,消融实验验证了系统各组件的关键作用。

原文摘要 · Abstract (English)

Bimanual dexterous grasping of large objects is a critical challenge in robotic manipulation. However, most existing studies focus on sequential manipulation rather than cooperative grasping, and methods addressing such bimanual tasks have largely been limited to simulation. These limitations stem from the difficulty of acquiring full 3D object models and generating physically plausible grasping actions. To fill this gap, we propose a real-world bimanual grasping framework that includes: a multimodal dataset capturing joint angles, visual observations and force signals; a Denoising Diffusion Probabilistic Model (DDPM)-based module that generates joint-level grasp configurations from segmented point clouds; and an execution strategy that integrates motion planning with online grasp refinement to ensure physical stability and feasibility. Our approach enables the synthesis of executable bimanual grasps from single-view inputs, reducing dependence on complete 3D object models and ensuring stable real-world performance. Experiments on a dual-arm robot demonstrate high success rates across unseen objects with varying geometries and poses, and ablation studies confirm the contributions of key components of our system.

双臂抓取扩散模型真实世界单视角

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。