不用图像匹配,用体素网格和颜色场直接恢复深度,速度快质量高。
Matching-Free Depth Recovery from Structured Light
- 用体素网格+可微渲染建模场景几何,避免传统匹配步骤。
- 少样本下深度误差降低约30%,真实与合成场景均表现优异。
- 适合需要快速训练的三维重建任务,尤其适用于结构光系统。
我们提出一种基于单目结构光系统的新型深度估计方法。不同于依赖图像匹配的现有方法,本方法采用密度体素网格表示场景几何,并通过自监督可微体积渲染进行训练。在渲染过程中利用结构光投影图案生成的颜色场,实现几何场的独立优化。该方法显著提升收敛速度并获得高质量结果。此外,引入归一化设备坐标(NDC)、畸变损失及基于表面的颜色损失,进一步提升几何保真度。实验表明,该方法在少样本场景下优于现有匹配类技术,合成与真实场景的平均深度误差均降低约30%。同时,训练速度比以往基于隐式表示的无匹配方法快约三倍。
原文摘要 · Abstract (English)
We introduce a novel approach for depth estimation using images obtained from monocular structured light systems. In contrast to many existing methods that depend on image matching, our technique employs a density voxel grid to represent scene geometry. This grid is trained through self-supervised differentiable volume rendering. Our method leverages color fields derived from the projected patterns in structured light systems during the rendering process, facilitating the isolated optimization of the geometry field. This innovative approach leads to faster convergence and high-quality results. Additionally, we integrate normalized device coordinates (NDC), a distortion loss, and a distinctive surface-based color loss to enhance geometric fidelity. Experimental results demonstrate that our method outperforms current matching-based techniques in terms of geometric performance in few-shot scenarios, achieving an approximately 30% reduction in average estimated depth errors for both synthetic scenes and real-world captured scenes. Moreover, our approach allows for rapid training, being approximately three times faster than previous matching-free methods that utilize implicit representations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。