arXiv:2606.25212cs.RO2026-06中稿 · IEEE/RSJ Internati…

用视觉模型+物理模拟,精准识别机器人抓取物体的动态参数。

RigPI: Dynamic Parameter Identification of Rigid Body via VLM-Seeded Differentiable Simulation

论文配图:RigPI: Dynamic Parameter Identification of Rigid Body via VLM-Seeded Differentiable Simulation
图 1 · 摘自论文原文
  • 结合视觉语义先验与可微物理仿真,初始化并优化物体参数。
  • 在真实物体上实现稳定参数估计,轨迹复现误差小。
  • 适合需要高精度物理建模的机器人操作与数字孪生场景。

精确识别被操作物体的物理参数是先进机器人操作和构建可信数字孪生的基础。然而,由于传感噪声、建模误差和先验知识有限,从真实交互中获取一致的惯性与摩擦参数仍具挑战。本文提出RigPI,一个系统化框架,用于在机器人-物体交互过程中识别自由刚体及多连杆刚体的动态参数。RigPI将基于视觉的语义先验、力矩传感器测量和运动观测整合至可微分仿真管道中。视觉语言模型(VLM)提供有指导的初始值和约束搜索空间,而可微物理模拟器的梯度信息实现高效稳定的参数优化。所提出的两阶段优化策略缓解了对噪声的敏感性,并避免物理上不合理的解。在含旋转与移动关节的真实物体上进行的大量实验表明,RigPI实现了准确且稳定的参数估计,并成功在真实机器人上重现了操控轨迹,具备参数感知的预测有效性。这些结果突显了RigPI在真实机器人系统识别任务中的有效性和鲁棒性。

原文摘要 · Abstract (English)

Accurate physical parameter identification of manipulated objects is fundamental to advanced robotic manipulation and the construction of faithful digital twins. However, acquiring physically consistent inertial and frictional properties from real-world interactions remains challenging due to sensing noise, modeling errors, and limited prior knowledge. This paper presents RigPI, a systematic framework for identifying dynamic parameters of both unconstrained rigid bodies and multi-link rigid bodies during robot-object interaction. RigPI integrates vision-based semantic priors, force-torque measurements, and motion observations within a differentiable simulation pipeline. A vision-language model (VLM) provides informed initialization and a constrained search space, while gradient information from a differentiable physics simulator enables efficient and stable parameter refinement. The proposed two-stage optimization strategy alleviates sensitivity to noise and avoids physically implausible solutions. Extensive real-world experiments on objects with revolute and prismatic joints demonstrate that RigPI achieves accurate and stable parameter estimates, and successfully reproduces manipulation trajectories on a real robot with parameter-aware predictive validity. These results highlight the effectiveness and robustness of RigPI for real-world robotic system identification tasks.

物理建模机器人操作可微仿真参数识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。