arXiv:2606.28826cs.CV2026-06

用无人机+高斯点云,让玻璃幕墙数字孪生更真实、可交互。

RefGlass-GS: A UAV-Enabled Fusion Framework for Photorealistic, Semantic and Interactive Digitization of Reflective Glass Facades via Gaussian Splatting

  • 分块识别玻璃面板,抗反光和背景干扰。
  • 优化无人机拍摄角度,提升新视角渲染质量13.15 dB。
  • 支持实例级建模,适合智慧建筑管理使用。

具有反射玻璃立面的建筑数字化面临几何失真、视图依赖纹理不真实以及基于物体的语义增强困难等问题。为此,我们提出RefGlass-GS,一种基于无人机的端到端融合框架,实现反射玻璃立面的逼真、语义化与可交互数字化。贡献包括:(1) 提出基于最大后验估计与结构规律的单个玻璃面板分割方法,对严重反射和背景干扰具有鲁棒性;(2) 构建无人机视角规划优化函数,最大化视图依赖外观覆盖,确保数据采集充分;(3) 设计改进的高斯点云渲染框架,引入反射MLP、新型延迟着色函数及两项增强正则项,有效建模高频近场反射;(4) 提出标准化数据组织范式,将基于高斯点云的表示结构化为基于对象的模型,支持数字孪生平台上的交互式设施管理。在真实场景实验中验证了方法的有效性与优越性:玻璃面板分割在mIoU上比现有最优方法提升0.1927,且仅本方法实现实例级面板提取;无人机视角规划使新视角合成的PSNR相比商用‘贴地飞行’方法提升13.15 dB;RefGlass-GS建模在反射场景下平均比现有高斯点云方法提升5.08 dB PSNR。

原文摘要 · Abstract (English)

Existing digitization of buildings with reflective glass facades suffers from geometric reconstruction distortion, unrealistic view-dependent texture rendering, and difficulties in object-based semantic enhancement. Therefore, we propose RefGlass-GS, a fusion framework that enables end-to-end UAV-based photorealistic, semantic, and interactive digitization of reflective glass facades. The contributions include: (1) proposing an individual glass panel segmentation method based on maximum a posteriori estimation with structural regularities, robust to severe reflection and background interference; (2) formulating a UAV viewpoint planning optimization function that maximizes the coverage of view-dependent appearance for sufficient data capture; (3) developing an optimized Gaussian Splatting framework with a Reflection MLP, a novel deferred shading function, and two enhanced regularization terms for effective modeling of high-frequency near-field reflections; (4) introducing a standardized data organization paradigm for structuring GS-based representations into object-based models, facilitating interactive facility management on digital twin platforms. Experiments on real-world reflective glass facade scenes validate the effectiveness and superiority of the proposed method. Specifically, the glass panel segmentation achieves an improvement of 0.1927 in mIoU over SOTA methods, and only our method enables instance-level panel extraction. The UAV view planning improves novel view synthesis for reflective facades by 13.15 dB in PSNR compared to commercially used nap-of-the-object planning methods. The RefGlass-GS modeling outperforms SOTA Gaussian Splatting approaches for reflective scenes with an average improvement of 5.08 dB in PSNR.

数字孪生玻璃幕墙高斯点云无人机建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。