用高斯混合模型高效计算多视角不确定性,让机器人实时获取可靠深度估计。
UfM*: Uncertainty from Motion* for DNN Depth Estimation Using Gaussians

- 通过高斯混合体比较前后帧,仅一次推理即可测多视角不一致。
- 在扫描数据上误差降低24-28%,能耗仅为集成方法的3%。
- 适合嵌入式机器人,63毫焦/图即可30帧实时运行。
在安全关键型机器人系统中,单目深度神经网络的可靠性依赖于准确的不确定性估计。传统方法如集成与采样类技术需对每张图像进行多次推断,带来显著的计算与内存开销。此外,仅基于单图预测的不确定性无法衡量同一区域在多视角间的预测分歧。本文提出不确定性从运动*(UfM*),通过紧凑的高斯混合模型比较前一帧与当前帧,仅需一次DNN推断即可高效测量多视角不一致性。相较于先前基于点云的方法,使用高斯体计算多视角分歧不仅更节省算力和内存,还能在三维空间区域间更精准地度量分歧。在100个分布外的ScanNet序列上,UfM*结合认知不确定性使期望校准误差降低24%-28%,能耗仅为集成方法的3%,内存占用仅为0.02%。实测表明,其在小型能效受限机器人搭载的Arm Cortex-A76 CPU上,每224x224图像仅消耗63毫焦,实现30帧/秒的实时运行,证明基于高斯的多视角分歧测量可为资源受限系统提供高效不确定性估计。
原文摘要 · Abstract (English)
Reliable uncertainty estimation is critical for deploying monocular depth deep neural networks (DNNs) in safety-critical robotic systems. Conventional uncertainty methods such as ensembles and sampling-based approaches require multiple inferences per image, incurring substantial compute and memory overhead. Moreover, uncertainty predicted from a single image misses out on measuring disagreement between predictions across views of the same region. We propose Uncertainty from Motion* (UfM*), an uncertainty estimation algorithm that measures multiview disagreement efficiently by comparing previous and current views using a compact Gaussian mixture, requiring only a single DNN inference per image. Using Gaussians to compute multiview disagreement is not only more compute- and memory-efficient than a prior approach using a point cloud, but also improves uncertainty by measuring disagreement across regions of 3D space. UfM* paired with aleatoric uncertainty improves expected calibration error by 24-28% compared to an ensemble, while requiring only 3% of the energy and 0.02% of the memory on 100 out-of-distribution ScanNet sequences. We demonstrate UfM* consumes only 63 mJ per 224x224 image while running real-time at 30 FPS on an Arm Cortex-A76 CPU onboard a miniature energy-constrained robot, highlighting that measuring multiview disagreement using Gaussians enables efficient uncertainty for resource-constrained robotic systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。