用触觉与空间信息联合估计物体类别和6D位姿,提升识别准确率。
Bayesian Active Object Recognition and 6D Pose Estimation from Multimodal Contact Sensing
- 基于贝叶斯框架融合触觉与非接触信息进行推理
- 在11个YCB物体上减少动作次数并提升定位精度
- 适合机器人抓取与复杂环境下的感知任务
本文提出一种主动触觉探索框架,用于联合实现物体识别与6D位姿估计。该方法将腕部力/力矩传感、GelSight触觉传感及自由空间约束整合进贝叶斯推理框架,在主动触觉探索过程中维持对物体类别与位姿的信念分布。通过融合接触与非接触证据,降低不确定性,增强联合分类-位姿估计的鲁棒性。为实现大假设空间下的高效推理,采用定制化粒子滤波器,根据新观测逐步采样粒子;所推断的信念进一步用于指导主动探索,在可达性约束下选择最具信息量的下一步触碰。为有效数据采集,开发了运动规划与控制框架,可规划可行触觉探索路径,处理意外接触,并通过触觉伺服实现GelSight与表面的对齐。在仿真与Franka Panda机器人上对11个YCB物体进行了评估,结果表明引入触觉与自由空间信息显著提升了识别与位姿估计的准确率与稳定性,同时减少了动作周期数。代码、数据集与补充材料将公开发布。
原文摘要 · Abstract (English)
We present an active tactile exploration framework for joint object recognition and 6D pose estimation. The proposed method integrates wrist force/torque sensing, GelSight tactile sensing, and free-space constraints within a Bayesian inference framework that maintains a belief over object class and pose during active tactile exploration. By combining contact and non-contact evidence, the framework reduces ambiguity and improves robustness in the joint class-pose estimation problem. To enable efficient inference in the large hypothesis space, we employ a customized particle filter that progressively samples particles based on new observations. The inferred belief is further used to guide active exploration by selecting informative next touches under reachability constraints. For effective data collection, a motion planning and control framework is developed to plan and execute feasible paths for tactile exploration, handle unexpected contacts and GelSight-surface alignment with tactile servoing. We evaluate the framework in simulation and on a Franka Panda robot using 11 YCB objects. Results show that incorporating tactile and free-space information substantially improves recognition and pose estimation accuracy and stability, while reducing the number of action cycles compared with force/torque-only baselines. Code, dataset, and supplementary material will be made available online.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。