同时优化相机成像模型,提升多视角3D场景重建质量
3D Scene-Camera Representation with Joint Camera Photometric Optimization
- 引入内外部光照模型,联合优化相机参数
- 在镜头脏污和暗角下仍能生成高质量3D表示
- 适合需要高保真重建的视觉任务,如AR/VR
从多视角图像构建3D场景是计算机视觉中的关键任务,广泛应用于各类场景。然而,相机成像固有的光照畸变会显著降低图像质量。若不考虑这些畸变,3D场景表示可能无意中包含与场景无关的错误信息,从而损害表示质量。本文提出一种结合相机光照优化的新型3D场景-相机表示方法。通过引入内部与外部光照模型,构建完整的光照模型及相机表征。在同步优化相机表征参数的同时,有效分离出与场景无关的信息。此外,在优化光照参数过程中引入深度正则化,防止3D场景表示拟合无关内容。通过将相机模型作为映射过程的一部分,该方法构建了一个包含场景辐射场与相机光照模型的完整地图。实验表明,即使在存在镜头暗角、污渍等成像退化条件下,该方法仍可实现高质量的3D场景重建。
原文摘要 · Abstract (English)
Representing scenes from multi-view images is a crucial task in computer vision with extensive applications. However, inherent photometric distortions in the camera imaging can significantly degrade image quality. Without accounting for these distortions, the 3D scene representation may inadvertently incorporate erroneous information unrelated to the scene, diminishing the quality of the representation. In this paper, we propose a novel 3D scene-camera representation with joint camera photometric optimization. By introducing internal and external photometric model, we propose a full photometric model and corresponding camera representation. Based on simultaneously optimizing the parameters of the camera representation, the proposed method effectively separates scene-unrelated information from the 3D scene representation. Additionally, during the optimization of the photometric parameters, we introduce a depth regularization to prevent the 3D scene representation from fitting scene-unrelated information. By incorporating the camera model as part of the mapping process, the proposed method constructs a complete map that includes both the scene radiance field and the camera photometric model. Experimental results demonstrate that the proposed method can achieve high-quality 3D scene representations, even under conditions of imaging degradation, such as vignetting and dirt.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。