用机器人触觉主动感知,提升手术中单目深度估计的精度与可靠性。
ProbeMDE: Uncertainty-Guided Active Proprioception for Monocular Depth Estimation in Surgical Robotics
- 融合视觉与稀疏触觉测量,通过集成模型评估预测不确定性。
- 在模拟与真实手术模型上,以更少触点实现更高精度深度图。
- 适合需要高精度感知的医疗机器人场景,尤其纹理缺失环境。
单目深度估计(MDE)是机器人感知的重要工具,但在缺乏纹理、反光和遮挡频繁的手术场景中常出现不确定性和误差。为此,我们提出ProbeMDE,一种成本感知的主动感知框架,结合RGB图像与稀疏本体感觉测量进行MDE。该方法利用一组MDE模型,基于RGB图像和通过本体感觉获得的已知稀疏深度测量值,生成稠密深度图。我们通过集成模型方差量化预测不确定性,并计算不确定性相对于候选测量位置的梯度。为防止模式坍缩,采用斯坦因变分梯度下降(SVGD)在该梯度图上选择最具信息量的触觉位置。我们在中心气道阻塞手术假体的仿真与物理实验中验证了该方法。结果表明,相比基线方法,我们的方案在标准深度估计指标上表现更优,实现了更高精度的同时最小化所需本体感觉测量次数。
原文摘要 · Abstract (English)
Monocular depth estimation (MDE) provides a useful tool for robotic perception, but its predictions are often uncertain and inaccurate in challenging environments such as surgical scenes where textureless surfaces, specular reflections, and occlusions are common. To address this, we propose ProbeMDE, a cost-aware active sensing framework that combines RGB images with sparse proprioceptive measurements for MDE. Our approach utilizes an ensemble of MDE models to predict dense depth maps conditioned on both RGB images and on a sparse set of known depth measurements obtained via proprioception, where the robot has touched the environment in a known configuration. We quantify predictive uncertainty via the ensemble's variance and measure the gradient of the uncertainty with respect to candidate measurement locations. To prevent mode collapse while selecting maximally informative locations to propriocept (touch), we leverage Stein Variational Gradient Descent (SVGD) over this gradient map. We validate our method in both simulated and physical experiments on central airway obstruction surgical phantoms. Our results demonstrate that our approach outperforms baseline methods across standard depth estimation metrics, achieving higher accuracy while minimizing the number of required proprioceptive measurements. Project page: https://brittonjordan.github.io/probe_mde/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。