用手机激光雷达做度量尺,实时生成高精度稀疏深度图。
Double-Helix Active Geometry: LiDAR-Anchored Multi-View Depth with Selective Abstention
- 以激光雷达为度量基准,结合视觉三角化补全深度
- 在2米内实现13.4%相对误差,覆盖64.2%远场有效区域
- 零训练参数,每帧仅1.11毫秒,适合嵌入式部署
消费级深度传感器(如最新iPhone的LiDAR)虽能提供真实距离,但有效范围短且点云稀疏。本文提出DH-Active,一种轻量、无需训练的几何后端,将传感器视为度量尺而非唯一深度来源。近场激光回波通过PnP确定两视图的相对位姿,无有效深度的可视觉追踪样本在此位姿下进行三角化。基于视差/重投影的门控机制在几何条件不佳时主动放弃估计,显式留出空洞并输出选择性置信度。核心前端(含螺旋采样、稀疏反投影、空洞分类)在CPU上中值延迟仅1.11毫秒(OpenCV 14线程),比GPU上的DINOv2-L视觉分支快约38倍。在两个iPhone数据集及TUM RGB-D、ARKitScenes公开基准上,外推深度误差达1.4%至6.7%中值相对误差。在控制实验中(仅使用2米内激光回波定标,独立激光扫描为真值),DH-Active在远场候选点中实现64.2%场景中位覆盖率,相对误差13.4%,而直接轨迹三角化不可用。我们还验证了多种失败方案:单帧散焦、经典聚焦堆叠、散焦-LiDAR融合、良好视觉惯性轨迹上的点对点ICP、注意力驱动的空洞重采样。一个12.6亿参数的模型在理想尺度对齐后仍更精确。本工作贡献在于:度量稀疏深度、显式放弃机制、零学习参数、近毫秒级CPU开销。
原文摘要 · Abstract (English)
Consumer depth sensors such as the LiDAR scanner on recent iPhones provide metric range, but their useful range is short and their returns are sparse. We present DH-Active, a lightweight, training-free geometry back-end that treats the sensor as a metric ruler rather than the sole source of depth. Near-field returns anchor the metric relative pose of two views through PnP; visually trackable samples without a valid depth return are then triangulated under that pose. A parallax/reprojection gate abstains wherever the geometry is ill-conditioned, leaving an explicit hole and a selective score instead of forcing an estimate. The measured core front end, including spiral sampling, sparse back-projection, and hole taxonomy but excluding preprocessing and multi-view recovery, runs at 1.11 ms median latency on CPU (OpenCV using 14 threads), about 38 times faster than a DINOv2-L visual branch on GPU in our timing setup. Across two iPhone captures and the public TUM RGB-D and ARKitScenes benchmarks, held-out depth is recovered at 1.4 to 6.7 percent median relative error. In a controlled ARKitScenes protocol that uses only returns within 2 m to set scale and an independent laser scan as ground truth, DH-Active achieves 64.2 percent scene-median coverage of evaluable far-field candidates at 13.4 percent scene-median relative error; direct triangulation from the device trajectory is not usable. We also report the alternatives that failed in our tests: single-frame defocus, classical focus-stack depth, defocus-LiDAR fusion, point-to-point ICP over a good visual-inertial track, and attention-to-holes resampling. A 1.26 B learned model remains more accurate after oracle scale alignment. The contribution here is narrower: metric sparse depth, explicit abstention, zero learned parameters, and near-millisecond CPU cost.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。