arXiv:2608.02014cs.ROcs.AI2026-08

用几何导向的3D高斯表示物体,实现跨机械手灵巧抓握的通用方案

MANGO-Grasp: Mahalanobis Fields over Geometry-Oriented 3D Gaussians for Cross-Embodiment Dexterous Grasping

论文配图:MANGO-Grasp: Mahalanobis Fields over Geometry-Oriented 3D Gaussians for Cross-Embodiment Dexterous Grasping
图 1 · 摘自论文原文
  • 物体用面向表面的3D高斯板表示,机器人用形态-运动描述符建模
  • 在模拟中比最强基线提升8.24%,零样本迁移至新机械手提升16.57%
  • 统一优化框架适配所有机械手,真实场景成功率达86%

跨机械手灵巧抓握旨在合成稳定抓取动作,适用于异构多指机械手且无需特定调优。现有以交互为中心的方法虽表现良好,但其物体表征常忽略局部表面几何细节,机器人描述也未显式编码形态与运动学信息。本文提出MANGO-Grasp,一种各向异性交互框架:将物体表示为几何导向的3D高斯原型,机器人手则通过表面关键点编码为形态-运动描述符。物体原型依据几何复杂度自适应分配,呈与表面对齐的板状结构,法向朝外,以编码局部几何特征。关键点与原型对之间的马氏场作为训练时的交互预测目标,并在推理时提供抓取优化引导。该场沿表面法向迅速上升,而在切平面内变化平缓,符合接触方向特性。所有机械手采用同一优化公式和超参数设置实现抓取。在CMAP与MultiGripperGrasp基准上,相比最强可见手基线,模拟性能最高提升8.24个百分点;零样本迁移到未见的SharpaWave手,优于最强零样本基线16.57个百分点;真实实验成功率达86%。代码与补充材料将在发布后公开于https://connor-zh.github.io/MANGO-Grasp/。

原文摘要 · Abstract (English)

Cross-embodiment dexterous grasping aims to synthesize stable grasps across heterogeneous multi-fingered hands with little or no embodiment-specific tuning. Existing interaction-centric methods achieve promising results, but their object representations often underrepresent local surface geometry, while their robot descriptors do not explicitly encode both robot morphology and kinematics. We propose MANGO-Grasp, an anisotropic interaction framework that represents objects as geometry-oriented 3D Gaussian primitives and robot hands as surface keypoints encoded into morpho-kinematic descriptors. The object primitives are adaptively allocated by geometric complexity and shaped as surface-aligned plates with outward normals, encoding local geometry. Mahalanobis fields over keypoint--primitive pairs serve as interaction prediction targets during training and as optimization guidance for grasp realization at inference. These fields rise sharply for displacement along the surface normal but only gently within the tangent plane, matching the directional structure of contact. Grasps are realized with one shared optimization formulation and hyperparameter setting across all embodiments. On the CMAP and MultiGripperGrasp benchmarks, MANGO-Grasp outperforms the strongest seen-hand baseline by up to 8.24 percentage points in simulation. It also transfers zero-shot to the unseen SharpaWave hand, improving over the strongest zero-shot baseline by up to 16.57 percentage points, and achieves 86% success in real-world experiments. The code and additional materials will be made available upon publication at https://connor-zh.github.io/MANGO-Grasp/.

灵巧抓握3D高斯跨机械手机器人感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。