给3D高斯点添加空间锚点,让它们更集中地分布于场景局部。
LocusGS: Spatially Grounded Tokens for Feed-Forward 3D Gaussian Splatting

- 为每个高斯查询引入3D中心与半径锚点,显式建模空间位置。
- 在相同高斯数量下,渲染质量显著优于传统方法。
- 适合关注3D重建空间结构优化的研究者或工程师。
基于查询的前馈3D高斯点播方法使用可学习查询来聚合多视角信息并解码一组高斯点。理想情况下,不同查询应专注于场景中连贯的局部区域。然而我们发现,同一查询解码出的高斯点常分散在远距离区域,导致查询级空间不连贯,与场景结构对齐差。这归因于现有高斯查询仅依赖纯隐式表示。为此,我们提出LocusGS,为每个高斯查询增加一个包含中心和支撑半径的3D锚点状态。该锚点状态在解码层间逐步优化,并贯穿查询交互、多视角特征聚合及高斯生成全过程。具体而言,锚点到射线的几何偏置引导查询关注空间相关的图像观测,锚点中心解码则将高斯点组织在局部区域内。在新视角合成基准上的实验表明,LocusGS在相同高斯预算下相比基线方法提升渲染质量。进一步分析显示,学习到的锚点形成连贯的空间布局,带来更结构化的高斯分布,证明显式锚点状态能有效改善空间组织。
原文摘要 · Abstract (English)
Recent query-based feed-forward 3DGS methods represent a scene using learnable queries, each aggregating multi-view evidence and decoding a group of Gaussians. Ideally, different queries should specialize in coherent local regions of the scene. However, we observe that Gaussians decoded from the same query often scatter across distant scene regions, resulting in weak query-level spatial coherence and poor alignment with the scene structure. We attribute this behavior to the purely latent representation of existing Gaussian queries. To address this limitation, we introduce LocusGS, which augments each Gaussian query with a 3D anchor state consisting of a center and a support radius. The anchor state is progressively refined across decoder layers and is used throughout query interaction, multi-view feature aggregation, and Gaussian generation. Specifically, an anchor-to-ray geometric bias guides each query toward spatially relevant image observations, while anchor-centered decoding organizes its Gaussians within a local region. Experiments on novel view synthesis benchmarks show that LocusGS improves rendering quality over query-based Gaussian token baselines under the same Gaussian budget. Further analysis shows that the learned anchors form coherent spatial layouts and lead to more structured Gaussian distributions, demonstrating that explicit anchor states improve the spatial organization. Our project page: https://leo-frank.github.io/LocusGS_viewer.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。