arXiv:2511.22233cs.CV2025-11被引 3

融合内外知识,提升3D高斯点云超分辨率质量

IE-SRGS: An Internal-External Knowledge Fusion Framework for High-Fidelity 3D Gaussian Splatting Super-Resolution

  • 用2D超分和深度图生成外部知识,3D高斯模型生成内部一致性知识
  • 在合成与真实数据上均超越现有方法,视觉效果与精度双优
  • 适合需要高质量3D重建的科研与工业应用

从低分辨率输入重建高分辨率3D高斯点云(3DGS)模型仍具挑战,因缺乏精细纹理与几何结构。现有方法多依赖预训练2D超分辨率(2DSR)模型增强纹理,但易受跨视角不一致和2DSR域差距影响,导致3D高斯模糊。本文提出IE-SRGS,一种新型3DGS超分框架,通过联合利用外部2DSR先验与内部3DGS特征的互补优势来解决该问题。具体地,采用2DSR和深度估计模型生成高分辨率图像与深度图作为外部知识,同时使用多尺度3DGS模型生成跨视角一致、领域自适应的内部知识。引入掩码引导融合策略,协同整合两类知识,有效指导3D高斯优化以实现高保真重建。在合成与真实世界基准上的大量实验表明,IE-SRGS在定量精度与视觉保真度上持续优于当前最优方法。

原文摘要 · Abstract (English)

Reconstructing high-resolution (HR) 3D Gaussian Splatting (3DGS) models from low-resolution (LR) inputs remains challenging due to the lack of fine-grained textures and geometry. Existing methods typically rely on pre-trained 2D super-resolution (2DSR) models to enhance textures, but suffer from 3D Gaussian ambiguity arising from cross-view inconsistencies and domain gaps inherent in 2DSR models. We propose IE-SRGS, a novel 3DGS SR paradigm that addresses this issue by jointly leveraging the complementary strengths of external 2DSR priors and internal 3DGS features. Specifically, we use 2DSR and depth estimation models to generate HR images and depth maps as external knowledge, and employ multi-scale 3DGS models to produce cross-view consistent, domain-adaptive counterparts as internal knowledge. A mask-guided fusion strategy is introduced to integrate these two sources and synergistically exploit their complementary strengths, effectively guiding the 3D Gaussian optimization toward high-fidelity reconstruction. Extensive experiments on both synthetic and real-world benchmarks show that IE-SRGS consistently outperforms state-of-the-art methods in both quantitative accuracy and visual fidelity.

3D高斯超分辨率知识融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。