arXiv:2411.09020cs.RO2024-11被引 12

机器人通过视觉与触觉感知,自主推断物体的物理属性。

Predictive Visuo-Tactile Interactive Perception Framework for Object Properties Inference

  • 结合推拉动作与视觉触觉数据,构建预测性感知框架
  • 在真实机器人实验中实现比现有方法更优的属性推断性能
  • 适用于物体追踪、目标驱动任务和环境变化检测

在非结构化环境中,自主机器人需持续探索未知物体的物理属性,如刚度、质量、质心、摩擦系数和形状,以实现稳定可控的操作,并预判抓取或非抓取动作的结果。本研究利用配备视觉与触觉传感器的机器人系统,针对多种均质、异质及铰接物体,提出一种新型预测性感知框架,通过非抓握式推和抓握式拉等多样探索动作,实现对物体属性的自主推断。框架包含主动形状感知机制以启动探索,采用基于图神经网络的双可微滤波器学习物体-机器人交互关系,实现对不可直接观测的时不变属性的一致推断;同时引入N步信息增益策略,主动选择最具信息量的动作以提升学习效率。大量真实机器人实验表明,该框架在平面物体上的表现优于当前最优基线方法,并成功应用于物体追踪、目标驱动任务和环境变化检测三大场景。

原文摘要 · Abstract (English)

Interactive exploration of the unknown physical properties of objects such as stiffness, mass, center of mass, friction coefficient, and shape is crucial for autonomous robotic systems operating continuously in unstructured environments. Precise identification of these properties is essential to manipulate objects in a stable and controlled way, and is also required to anticipate the outcomes of (prehensile or non-prehensile) manipulation actions such as pushing, pulling, lifting, etc. Our study focuses on autonomously inferring the physical properties of a diverse set of various homogeneous, heterogeneous, and articulated objects utilizing a robotic system equipped with vision and tactile sensors. We propose a novel predictive perception framework for identifying object properties of the diverse objects by leveraging versatile exploratory actions: non-prehensile pushing and prehensile pulling. As part of the framework, we propose a novel active shape perception to seamlessly initiate exploration. Our innovative dual differentiable filtering with Graph Neural Networks learns the object-robot interaction and performs consistent inference of indirectly observable time-invariant object properties. In addition, we formulate a $N$-step information gain approach to actively select the most informative actions for efficient learning and inference. Extensive real-robot experiments with planar objects show that our predictive perception framework results in better performance than the state-of-the-art baseline and demonstrate our framework in three major applications for i) object tracking, ii) goal-driven task, and iii) change in environment detection.

机器人感知触觉反馈属性推断主动学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。