用散射激光+相机融合,让手持3D扫描在暗光下也能清晰成像
Blurred LiDAR for Sharper 3D: Robust Handheld 3D Scanning with Diffuse LiDAR and RGB
- 用扩散闪光替代点阵激光,提升场景覆盖范围
- 融合RGB与模糊激光信号,实现高精度几何与颜色重建
- 适合低纹理、弱光等复杂环境下的移动3D扫描
3D表面重建在虚拟现实、机器人和移动扫描中至关重要。然而,基于RGB的重建在低纹理、低光照和低反照率场景中常失效。当前主流的手持式稀疏LiDAR通过投射点阵并测量飞行时间获取深度,但受限于输入视角少,导致深度信息覆盖不足。本文提出使用一种“模糊”型扩散激光,以宽视场发射闪光,显著提升场景覆盖,但引入了因多路径飞行时间混合带来的空间模糊。为此,我们结合扩散激光与RGB的优势,提出基于高斯贴片的渲染框架及自适应损失函数,动态平衡两者信号。实验表明,令人意外的是,扩散激光可超越传统稀疏激光,在复杂环境下实现鲁棒的3D扫描,精准还原几何与颜色。
原文摘要 · Abstract (English)
3D surface reconstruction is essential across applications of virtual reality, robotics, and mobile scanning. However, RGB-based reconstruction often fails in low-texture, low-light, and low-albedo scenes. Handheld LiDARs, now common on mobile devices, aim to address these challenges by capturing depth information from time-of-flight measurements of a coarse grid of projected dots. Yet, these sparse LiDARs struggle with scene coverage on limited input views, leaving large gaps in depth information. In this work, we propose using an alternative class of "blurred" LiDAR that emits a diffuse flash, greatly improving scene coverage but introducing spatial ambiguity from mixed time-of-flight measurements across a wide field of view. To handle these ambiguities, we propose leveraging the complementary strengths of diffuse LiDAR with RGB. We introduce a Gaussian surfel-based rendering framework with a scene-adaptive loss function that dynamically balances RGB and diffuse LiDAR signals. We demonstrate that, surprisingly, diffuse LiDAR can outperform traditional sparse LiDAR, enabling robust 3D scanning with accurate color and geometry estimation in challenging environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。