解决光照不一致下三维表面重建难题,提升机器人环境感知精度。
GS-I$^{3}$: Gaussian Splatting for Surface Reconstruction from Illumination-Inconsistent Images
- 用CNN校正单视角图像的亮度偏差,减少优化偏见。
- 融合单视图与多视图法向量,补偿光照差异导致的几何错位。
- 在复杂光照下实现高精度重建,适合机器人自主探索场景。
精确的几何表面重建对于导航与操作任务至关重要,是机器人自我探索与交互的基础。近年来,3D高斯点阵(3DGS)因其出色的几何质量与计算效率,在表面重建领域备受关注。尽管已有研究在光照不一致条件下实现新视角合成取得进展,但鲁棒的表面重建仍面临挑战。为此,本文提出GS-3I方法:针对单视图图像中欠曝区域引起的3D高斯优化偏差,引入基于卷积神经网络(CNN)的色调映射校正框架;针对多视图图像因相机设置差异和复杂光照造成的几何约束不匹配问题,提出一种法向量补偿机制,融合单视图提取的参考法向量与多视图观测计算的法向量,有效约束几何偏差。大量实验表明,GS-3I可在复杂光照场景下实现鲁棒且精准的表面重建,验证了其在该关键挑战中的有效性与通用性。
原文摘要 · Abstract (English)
Accurate geometric surface reconstruction, providing essential environmental information for navigation and manipulation tasks, is critical for enabling robotic self-exploration and interaction. Recently, 3D Gaussian Splatting (3DGS) has gained significant attention in the field of surface reconstruction due to its impressive geometric quality and computational efficiency. While recent relevant advancements in novel view synthesis under inconsistent illumination using 3DGS have shown promise, the challenge of robust surface reconstruction under such conditions is still being explored. To address this challenge, we propose a method called GS-3I. Specifically, to mitigate 3D Gaussian optimization bias caused by underexposed regions in single-view images, based on Convolutional Neural Network (CNN), a tone mapping correction framework is introduced. Furthermore, inconsistent lighting across multi-view images, resulting from variations in camera settings and complex scene illumination, often leads to geometric constraint mismatches and deviations in the reconstructed surface. To overcome this, we propose a normal compensation mechanism that integrates reference normals extracted from single-view image with normals computed from multi-view observations to effectively constrain geometric inconsistencies. Extensive experimental evaluations demonstrate that GS-3I can achieve robust and accurate surface reconstruction across complex illumination scenarios, highlighting its effectiveness and versatility in this critical challenge. https://github.com/TFwang-9527/GS-3I
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。