通过物体感知的不确定性估计,提升3D高斯溅射中目标物体重建效率。
OUGS: Active View Selection via Object-aware Uncertainty Estimation in 3DGS
- 基于3D高斯参数协方差与渲染雅可比传播,构建可解释的不确定性模型。
- 结合语义分割掩码,实现对象级不确定性评分,显著提升目标物体重建质量。
- 适用于复杂场景中需聚焦特定物体的高效3D重建任务。
最近的3D高斯溅射(3DGS)进展在新视角合成上达到了最先进水平。然而,在复杂场景中高效捕捉特定物体的高保真重建仍是重大挑战。现有主动重建方法主要依赖场景级不确定性度量,常受无关背景干扰,导致对象中心任务的视图选择效率低下。我们提出OUGS,一种基于更严谨物理基础的不确定性公式化框架。核心创新在于从3D高斯原语的显式物理参数(如位置、尺度、旋转)直接推导不确定性。通过将这些参数的协方差经渲染雅可比传播,建立高度可解释的不确定性模型。在此基础上,无缝集成语义分割掩码,生成精准的目标感知不确定性得分,有效分离对象与其环境。从而实现更优的主动视图选择策略,优先选取对提升对象保真度至关重要的视图。在公开数据集上的实验表明,该方法显著提升了3DGS重建过程的效率,并在目标物体重建质量上优于现有最先进方法,同时作为全局场景的稳健不确定性估计器也表现良好。
原文摘要 · Abstract (English)
Recent advances in 3D Gaussian Splatting (3DGS) have achieved state-of-the-art results for novel view synthesis. However, efficiently capturing high-fidelity reconstructions of specific objects within complex scenes remains a significant challenge. A key limitation of existing active reconstruction methods is their reliance on scene-level uncertainty metrics, which are often biased by irrelevant background clutter and lead to inefficient view selection for object-centric tasks. We present OUGS, a novel framework that addresses this challenge with a more principled, physically-grounded uncertainty formulation for 3DGS. Our core innovation is to derive uncertainty directly from the explicit physical parameters of the 3D Gaussian primitives (e.g., position, scale, rotation). By propagating the covariance of these parameters through the rendering Jacobian, we establish a highly interpretable uncertainty model. This foundation allows us to then seamlessly integrate semantic segmentation masks to produce a targeted, object-aware uncertainty score that effectively disentangles the object from its environment. This allows for a more effective active view selection strategy that prioritizes views critical to improving object fidelity. Experimental evaluations on public datasets demonstrate that our approach significantly improves the efficiency of the 3DGS reconstruction process and achieves higher quality for targeted objects compared to existing state-of-the-art methods, while also serving as a robust uncertainty estimator for the global scene.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。