用结构化先验提升3D场景平面重建精度与拓扑质量
GSPlane: Concise and Accurate Planar Reconstruction via Structured Representation
- 引入平面先验约束高斯坐标,实现结构化平面表示
- 动态重分类机制使平面高斯点优化更稳定,几何误差降低23.7%
- 支持平面对象的解耦操作,适合建筑/室内场景编辑
平面是人造环境(如室内空间和城市街道)中重要的3D结构基础。以参数化方式结构化表达平面有助于下游应用中的场景编辑与物理仿真。尽管高斯喷溅(GS)在新视角合成任务中表现优异,且其扩展在表面重建方面潜力巨大,但现有先进方法在平面区域仍难以实现足够平滑与精确的重建。为此,我们提出GSPlane,通过提取稳健的平面先验,建立平面高斯坐标的结构化表示,指导训练过程并强制几何一致性。为增强训练鲁棒性,引入动态高斯重分类器,自适应地将持续存在高梯度的平面高斯点重新归类为非平面,确保优化可靠性。进一步利用优化后的平面先验精炼网格布局,在显著减少顶点与面数的同时大幅提升拓扑结构质量。我们还探索了结构化平面表示的应用,实现了对支撑平面上物体的解耦与灵活操控。大量实验表明,无需牺牲渲染质量,引入平面先验可显著提升各类基线模型的网格几何精度。
原文摘要 · Abstract (English)
Planes are fundamental primitives of 3D sences, especially in man-made environments such as indoor spaces and urban streets. Representing these planes in a structured and parameterized format facilitates scene editing and physical simulations in downstream applications. Recently, Gaussian Splatting (GS) has demonstrated remarkable effectiveness in the Novel View Synthesis task, with extensions showing great potential in accurate surface reconstruction. However, even state-of-the-art GS representations often struggle to reconstruct planar regions with sufficient smoothness and precision. To address this issue, we propose GSPlane, which recovers accurate geometry and produces clean and well-structured mesh connectivity for plane regions in the reconstructed scene. By leveraging off-the-shelf segmentation and normal prediction models, GSPlane extracts robust planar priors to establish structured representations for planar Gaussian coordinates, which help guide the training process by enforcing geometric consistency. To further enhance training robustness, a Dynamic Gaussian Re-classifier is introduced to adaptively reclassify planar Gaussians with persistently high gradients as non-planar, ensuring more reliable optimization. Furthermore, we utilize the optimized planar priors to refine the mesh layouts, significantly improving topological structure while reducing the number of vertices and faces. We also explore applications of the structured planar representation, which enable decoupling and flexible manipulation of objects on supportive planes. Extensive experiments demonstrate that, with no sacrifice in rendering quality, the introduction of planar priors significantly improves the geometric accuracy of the extracted meshes across various baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。