arXiv:2602.06834cs.RO2026-02被引 1

用关键点与卡尔曼滤波闭环控制,让机械臂精准抓取无纹理物体。

Perception-Control Coupled Visual Servoing for Textureless Objects Using Keypoint-Based EKF

  • 基于关键点检测与EKF融合,实时估计6维物体位姿。
  • 在真实机器人上实现定位误差低于3.2mm,抓取成功率达94%。
  • 首次实现感知-控制耦合的不确定性感知控制,适合复杂环境应用。

视觉伺服是机器人应用的核心技术,可实现精确定位与控制。然而,由于缺乏可靠视觉特征,对无纹理物体的视觉伺服仍具挑战性。此外,遮挡等不良视觉条件常导致视觉反馈失真,降低精度并引发不稳定性。本文基于学习型关键点检测,提出一种将感知与控制紧密耦合于闭环中的方法。具体而言,采用扩展卡尔曼滤波(EKF)融合每帧关键点测量,估计6维物体位姿,并驱动基于位姿的视觉伺服(PBVS)进行控制。生成的相机运动反过来增强后续关键点追踪效果,形成感知-控制闭环。此外,不同于传统PBVS,我们提出一种概率性控制律,同时计算相机速度及其不确定性,实现不确定性感知控制,保障操作安全可靠。我们在真实机器人平台上通过定量指标与抓取实验验证了该方法,结果表明其在精度与实际应用中均优于传统视觉伺服技术。

原文摘要 · Abstract (English)

Visual servoing is fundamental to robotic applications, enabling precise positioning and control. However, applying it to textureless objects remains a challenge due to the absence of reliable visual features. Moreover, adverse visual conditions, such as occlusions, often corrupt visual feedback, leading to reduced accuracy and instability in visual servoing. In this work, we build upon learning-based keypoint detection for textureless objects and propose a method that enhances robustness by tightly integrating perception and control in a closed loop. Specifically, we employ an Extended Kalman Filter (EKF) that integrates per-frame keypoint measurements to estimate 6D object pose, which drives pose-based visual servoing (PBVS) for control. The resulting camera motion, in turn, enhances the tracking of subsequent keypoints, effectively closing the perception-control loop. Additionally, unlike standard PBVS, we propose a probabilistic control law that computes both camera velocity and its associated uncertainty, enabling uncertainty-aware control for safe and reliable operation. We validate our approach on real-world robotic platforms using quantitative metrics and grasping experiments, demonstrating that our method outperforms traditional visual servoing techniques in both accuracy and practical application.

视觉伺服6D位姿估计机器人控制关键点检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。