arXiv:2606.09314cs.RO2026-06

用关键点流匹配生成灵巧抓取,无需接触损失或测试时优化。

KPGrasp: Scalable Keypoint Flow Matching for Dexterous Grasp Generation

论文配图:KPGrasp: Scalable Keypoint Flow Matching for Dexterous Grasp Generation
图 1 · 摘自论文原文
  • 基于欧氏空间手部关键点参数化与可扩展的Transformer流模型。
  • 在Dexonomy上达76.3%成功率,比最强基线提升47.4%,穿透深度仅2.4mm。
  • 适合需要高效、高精度灵巧抓取的机器人应用,支持批量推理与真实部署。

学习型方法生成高质量灵巧抓取仍具挑战,常依赖精心调校的接触损失或昂贵的接触式测试时优化。本文提出KPGrasp,一种基于流匹配的框架,从大规模数据中学习灵巧抓取先验,无需接触损失或接触式测试时优化。该方法结合全欧氏3D手部关键点参数化与简单且可扩展的Transformer流模型。参数化避免了传统混合SE(3)姿态与关节角输出空间的缺陷,以与物体点云相同坐标系表达抓取,实现原生空间推理;流模型仅使用标准流匹配损失训练,随数据量、模型容量和批大小有效扩展。实验表明,在两个仿真基准上达到领先性能:在Dexonomy基准上达成76.3%抓取成功率,比最强可比基线提升47.4%,穿透深度降至2.4 mm;同一模型在DexGrasp Anything基准上无需微调即取得最佳平均表现。批量推理仅需每抓取0.032秒。最终,20种不同物体的真实世界实验验证了该流程可在真实场景中部署。

原文摘要 · Abstract (English)

Generating high-quality dexterous grasps remains challenging for learning-based methods, which often depend on carefully tuned contact losses or costly contact-based test-time refinement. We present KPGrasp, a flow-matching framework that learns dexterous grasp priors from large-scale data rather than relying on contact losses or contact-based test-time refinement. KPGrasp couples an all-Euclidean 3D hand-keypoint parameterization with a simple yet scalable Transformer flow model. The parameterization avoids the drawbacks of the conventional mixed SE(3) pose and joint-angle output space, expresses grasps in the same frame as the object point cloud, and thus enables native spatial reasoning; the Transformer flow model is trained with only the standard flow-matching loss and scales effectively with data, model capacity, and batch size. Experiments demonstrate state-of-the-art performance on two simulation benchmarks. On the Dexonomy benchmark, it reaches a 76.3% grasp success rate, improving over the strongest directly comparable baseline by 47.4% while reducing penetration depth to 2.4 mm. The same model also achieves the best average performance on the DexGrasp Anything benchmark without fine-tuning. For batched inference, KPGrasp requires only 0.032 s per grasp. Finally, real-world experiments on 20 diverse objects demonstrate that the pipeline can be deployed in a real-world setup.

灵巧抓取流匹配机器人3D参数化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。