arXiv:2608.10712cs.CV2026-08

用注意力引导的聚类方法,把海量3D高斯点压缩到1/20,还保持清晰画质。

Compact Feed-Forward 3D Gaussians via Saliency-Guided Primitive Merging

  • 通过显著性图指导自适应超像素分组,纹理区细分、平滑区粗分
  • 将每簇高斯点压缩为潜在向量,跨视角匹配合并,最终仅需原数量1/20
  • 可作为通用后处理模块,适合需要高效渲染的3D重建场景

3D场景重建、建模与渲染在诸多任务中至关重要,3D高斯溅射已成为该领域的标准方法。其前馈变体能从稀疏视图快速重建,但通常生成逐像素的高斯点,导致冗余且效率低下。本文提出一种结构感知的合并流程,可接收任意前馈方法产生的逐像素高斯点,并将其整合为紧凑、内容自适应的高斯集合,视觉质量基本不变,高斯点数量仅为逐像素方法的1/20。该方法通过显著性图引导的自适应超像素分割,将空间上连贯且外观相似的高斯点聚成可变大小的簇,其中纹理区域分配精细分块,均匀区域分配粗略分块。每个簇通过学习编码器压缩为紧凑潜在表示,再基于几何重叠和特征相似性,通过学习合并器在多视角间匹配并整合表示。最后,通过层次细节解码器以可控分辨率生成最终高斯点,实现推理时灵活的质量-效率权衡。作为后处理模块,该流程对骨干网络无依赖,充分利用现有前馈方法的优势,相比以往减少高斯点数的方法,实现了更优且更鲁棒的视觉质量,同时提供高度紧凑的表示,支持高效渲染。

原文摘要 · Abstract (English)

3D scene reconstruction, modeling, and rendering are highly relevant for numerous tasks, and 3D Gaussian splatting has become a standard choice in this context. Its feed-forward variants provide fast reconstruction from sparse input views but often produce per-pixel primitives, leading to highly redundant and thus inefficient representations. We present a structure-aware merging pipeline that takes per-pixel primitives from any feed-forward method and consolidates them into a compact, content-adaptive Gaussian set while largely retaining visual quality at just $\frac{1}{20}^\text{th}$ of the Gaussians of a per-pixel method. We group spatially coherent Gaussians of similar appearance into variable-size clusters via adaptive superpixel segmentation guided by a saliency map, which allocates fine segments to textured regions and coarse segments to homogeneous areas. We compress each cluster into a compact latent representation through a learned encoder, then match and consolidate representations across views based on geometric overlap and feature similarity via a learned merger. A level-of-detail decoder then produces the final Gaussians at a controllable resolution, enabling a flexible quality-efficiency trade-off at inference. As a post-processing module, the pipeline is backbone-agnostic, leveraging the strengths of existing feed-forward methods. This leads to better and more robust quality than achieved by previous approaches that target a reduction in primitive count, while providing a highly compact representation, that can be rendered efficiently.

3D重建高斯溅射压缩高效渲染

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。