HBSplat提升稀疏视角3D重建质量,解决漂浮物和结构断裂问题。
HBSplat: Robust Sparse-View Gaussian Reconstruction with Hybrid-Loss Guided Depth and Bidirectional Warping
- 融合混合损失深度估计,强化多视角一致性
- 双向变形生成高保真虚拟视图,提升约束力
- 基于深度差掩码的补全模块,修复遮挡区域
从稀疏视角进行新视角合成(NVS)在3D重建中面临巨大挑战,因多视角约束不足导致严重过拟合、几何失真和场景碎片化。尽管3D高斯点阵(3DGS)可实现实时高保真渲染,但在稀疏输入下性能急剧下降,存在漂浮伪影和结构失效问题。为此,我们提出HBSplat,一个统一框架,通过无缝集成鲁棒结构线索、虚拟视图约束和遮挡区域补全,显著提升3DGS表现。核心贡献包括:1)混合损失深度估计模块,利用密集匹配先验,结合重投影、点传播与平滑性约束,确保多视角一致性;2)双向变形虚拟视图合成方法,通过双向深度图像变形与多视角融合生成高质量虚拟视图,施加更强约束;3)遮挡感知重建组件,采用深度差掩码与学习式修复模型恢复遮挡区域。在LLFF、Blender和DTU基准上的大量实验表明,HBSplat达到新最优水平,最高实现21.13 dB PSNR与0.189 LPIPS,同时保持实时推理。代码已开源。
原文摘要 · Abstract (English)
Novel View Synthesis (NVS) from sparse views presents a formidable challenge in 3D reconstruction, where limited multi-view constraints lead to severe overfitting, geometric distortion, and fragmented scenes. While 3D Gaussian Splatting (3DGS) delivers real-time, high-fidelity rendering, its performance drastically deteriorates under sparse inputs, plagued by floating artifacts and structural failures. To address these challenges, we introduce HBSplat, a unified framework that elevates 3DGS by seamlessly integrating robust structural cues, virtual view constraints, and occluded region completion. Our core contributions are threefold: a Hybrid-Loss Depth Estimation module that ensures multi-view consistency by leveraging dense matching priors and integrating reprojection, point propagation, and smoothness constraints; a Bidirectional Warping Virtual View Synthesis method that enforces substantially stronger constraints by creating high-fidelity virtual views through bidirectional depth-image warping and multi-view fusion; and an Occlusion-Aware Reconstruction component that recovers occluded areas using a depth-difference mask and a learning-based inpainting model. Extensive evaluations on LLFF, Blender, and DTU benchmarks validate that HBSplat sets a new state-of-the-art, achieving up to 21.13 dB PSNR and 0.189 LPIPS, while maintaining real-time inference. Code is available at: https://github.com/eternalland/HBSplat.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。