通过视图对齐提升高斯点云的几何精度,解决多视角一致性问题。
VA-GS: Enhancing the Geometric Representation of Gaussian Splatting via View Alignment
- 引入边缘感知渲染损失,增强表面边界刻画。
- 提出可见性感知光度对齐损失,改善跨视角空间一致性。
- 结合法向约束与深度特征对齐,提升光照变化下的重建鲁棒性。
3D高斯点云最近成为高质量实时新视角合成的有效方案,但其在精确表面重建方面仍存在不足。由于高斯分布离散且无结构,仅依赖图像渲染损失的监督常导致几何失真和多视角对齐不一致。本文提出一种通过视图对齐(VA)增强3D高斯几何表示的新方法。具体地,将边缘感知图像线索融入渲染损失以提升表面边界清晰度;设计可见性感知光度对齐损失,建模遮挡关系并促进高斯间准确的空间关系;为缓解光照变化带来的歧义,引入法向约束以优化高斯的空间朝向并改进局部表面估计;同时利用深度图像特征嵌入强化跨视角一致性,提升不同视角与光照条件下的几何学习鲁棒性。在标准基准上的大量实验表明,该方法在表面重建与新视角合成任务上均达到当前最优性能。代码已开源:https://github.com/LeoQLi/VA-GS。
原文摘要 · Abstract (English)
3D Gaussian Splatting has recently emerged as an efficient solution for high-quality and real-time novel view synthesis. However, its capability for accurate surface reconstruction remains underexplored. Due to the discrete and unstructured nature of Gaussians, supervision based solely on image rendering loss often leads to inaccurate geometry and inconsistent multi-view alignment. In this work, we propose a novel method that enhances the geometric representation of 3D Gaussians through view alignment (VA). Specifically, we incorporate edge-aware image cues into the rendering loss to improve surface boundary delineation. To enforce geometric consistency across views, we introduce a visibility-aware photometric alignment loss that models occlusions and encourages accurate spatial relationships among Gaussians. To further mitigate ambiguities caused by lighting variations, we incorporate normal-based constraints to refine the spatial orientation of Gaussians and improve local surface estimation. Additionally, we leverage deep image feature embeddings to enforce cross-view consistency, enhancing the robustness of the learned geometry under varying viewpoints and illumination. Extensive experiments on standard benchmarks demonstrate that our method achieves state-of-the-art performance in both surface reconstruction and novel view synthesis. The source code is available at https://github.com/LeoQLi/VA-GS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。