arXiv:2509.25603cs.CV2025-09被引 3

按需提升局部细节分辨率,实现高效高精度场景重建。

GaussianLens: Localized High-Resolution Reconstruction via On-Demand Gaussian Densification

  • 基于低分辨率3DGS,按用户指定区域动态增加高密度点云。
  • 支持最高1024×1024图像输入,局部细节重建效果优于现有方法。
  • 适合需要高精度局部细节但无需全图高清的三维重建场景。

人类感知具有注意力聚焦特性,对关键区域(如超市货架标签)更关注。传统3D高斯溅射(3DGS)虽能快速从稀疏视角重建场景,但输出分辨率均匀,难以支持高分辨率训练,无法充分利用原始高分辨率图像。现有逐场景优化方法虽可生成精细细节,但依赖密集观测且耗时长。为弥合高分辨率全局重建成本过高与局部细节需求之间的差距,我们提出「按需高分辨率局部重建」问题:在已有低分辨率3DGS基础上,通过稀疏高分辨率图像,学习一个通用网络,在用户指定兴趣区域(RoI)内动态增强高斯密度,以捕捉精细细节。该方法避免了全图高分辨率重建的冗余开销,充分挖掘关键区域的高分辨率信息。我们提出GaussianLens,一种前馈式密化框架,融合初始3DGS与多视角图像的多模态信息,并设计像素引导的密化机制,在大幅提高分辨率下仍能有效捕捉细节。实验表明,该方法在局部细节重建上表现优异,且可扩展至最高1024×1024分辨率图像。

原文摘要 · Abstract (English)

We perceive our surroundings with an active focus, paying more attention to regions of interest, such as the shelf labels in a grocery store. When it comes to scene reconstruction, this human perception trait calls for spatially varying degrees of detail ready for closer inspection in critical regions, preferably reconstructed on demand. While recent works in 3D Gaussian Splatting (3DGS) achieve fast, generalizable reconstruction from sparse views, their uniform resolution output leads to high computational costs unscalable to high-resolution training. As a result, they cannot leverage available images at their original high resolution to reconstruct details. Per-scene optimization methods reconstruct finer details with adaptive density control, yet require dense observations and lengthy offline optimization. To bridge the gap between the prohibitive cost of high-resolution holistic reconstructions and the user needs for localized fine details, we propose the problem of localized high-resolution reconstruction via on-demand Gaussian densification. Given a low-resolution 3DGS reconstruction, the goal is to learn a generalizable network that densifies the initial 3DGS to capture fine details in a user-specified local region of interest (RoI), based on sparse high-resolution observations of the RoI. This formulation avoids the high cost and redundancy of uniformly high-resolution reconstructions and fully leverages high-resolution captures in critical regions. We propose GaussianLens, a feed-forward densification framework that fuses multi-modal information from the initial 3DGS and multi-view images. We further design a pixel-guided densification mechanism that effectively captures details under large resolution increases. Experiments demonstrate our method's superior performance in local fine detail reconstruction and strong scalability to images of up to $1024\times1024$ resolution.

3D重建高斯溅射局部优化实时渲染

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。