arXiv:2607.10237cs.CV2026-07

无需训练即可将3D场景压缩至几百万字节,同时保持高精度文本查询能力。

CoSAG: Compact Semantic Anchor Gaussians via Training-Free Rate-Distortion Coding

论文配图:CoSAG: Compact Semantic Anchor Gaussians via Training-Free Rate-Distortion Coding
图 1 · 摘自论文原文
  • 用空间锚点和熵编码直接压缩每个高斯点的语义绑定,不依赖场景特定训练
  • 存储体积缩小37到76倍,比LangSplatV2更小且精度更高
  • 适合需要轻量化部署的开放词汇3D场景应用

开放词汇3D场景理解通常通过将CLIP等2D视觉语言特征嵌入3D高斯溅射场景实现,使其支持文本查询。然而,为数百万个高斯点附加高维特征会使单个场景膨胀至数十亿字节,成为存储与部署的主要瓶颈。现有紧凑方法均需为每个场景学习专属编码器、自编码器、量化码本或蒸馏特征场,导致场景构建与存储紧密耦合,且未压缩占据主要成本的每高斯点语义分配。我们提出CoSAG,通过闭式透射加权提升、空间定位语义锚点和多视角去噪,在无需任何场景级训练的情况下构建语义场,并使用空间预测熵编码器进行存储,无需携带解码器。由于锚点具有空间位置约束,语义绑定具有可预测性,因而高度可压缩。透射加权提升与多视角去噪生成一致清晰的分配,使熵编码几乎无需额外率来修正噪声,仅编码相对于空间预测的残差。CoSAG在2D渲染、3D选择和密集LSeg协议上达到或超越当前最优性能,相比LangSplatV2在更高精度下将场景大小压缩37至76倍。

原文摘要 · Abstract (English)

Open-vocabulary 3D scene understanding is commonly achieved by embedding 2D vision-language features such as CLIP into a 3D Gaussian Splatting scene, turning it into a text-queryable semantic field. However, attaching a high-dimensional feature to each of millions of Gaussians inflates a single scene to gigabytes, which makes storage and deployment the real bottleneck of these fields. Existing compact methods each learn and ship a per-scene codec, an autoencoder, a quantized codebook, or a distilled feature field, entangling field construction with field storage and never compressing the per-Gaussian assignment that holds the bulk of the cost. We argue that construction and storage should be decoupled, and that storage is a rate-distortion problem over the per-Gaussian binding to a small anchor table, a structure no prior open-vocabulary method compresses. We present CoSAG, which constructs the field without any per-scene training through a closed-form transmittance-weighted lift, spatially grounded semantic anchors, and multi-view denoising, and stores it with a spatially predictive entropy coder that ships no decoder. Because the anchors are spatially grounded, the binding is predictable and therefore highly compressible. The transmittance-weighted lift and multi-view denoising yield a clean, view-consistent assignment, so the entropy coder spends almost no rate on correcting noise and instead codes only the residual against its spatial prediction. CoSAG reaches sub-megabyte storage while matching or exceeding the state of the art across the 2D-rendered, 3D-selection, and dense-LSeg protocols, reducing field size by 37 to 76x relative to LangSplatV2 at higher accuracy.

3D生成高效存储语义场高斯溅射

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。