无需训练即可将3D场景压缩至几百万字节,同时保持高精度文本查询能力。
CoSAG: Compact Semantic Anchor Gaussians via Training-Free Rate-Distortion Coding

- 用空间锚点和熵编码直接压缩每个高斯点的语义绑定,不依赖场景特定训练
- 存储体积缩小37到76倍,比LangSplatV2更小且精度更高
- 适合需要轻量化部署的开放词汇3D场景应用
开放词汇3D场景理解通常通过将CLIP等2D视觉语言特征嵌入3D高斯溅射场景实现,使其支持文本查询。然而,为数百万个高斯点附加高维特征会使单个场景膨胀至数十亿字节,成为存储与部署的主要瓶颈。现有紧凑方法均需为每个场景学习专属编码器、自编码器、量化码本或蒸馏特征场,导致场景构建与存储紧密耦合,且未压缩占据主要成本的每高斯点语义分配。我们提出CoSAG,通过闭式透射加权提升、空间定位语义锚点和多视角去噪,在无需任何场景级训练的情况下构建语义场,并使用空间预测熵编码器进行存储,无需携带解码器。由于锚点具有空间位置约束,语义绑定具有可预测性,因而高度可压缩。透射加权提升与多视角去噪生成一致清晰的分配,使熵编码几乎无需额外率来修正噪声,仅编码相对于空间预测的残差。CoSAG在2D渲染、3D选择和密集LSeg协议上达到或超越当前最优性能,相比LangSplatV2在更高精度下将场景大小压缩37至76倍。
原文摘要 · Abstract (English)
Open-vocabulary 3D scene understanding is commonly achieved by embedding 2D vision-language features such as CLIP into a 3D Gaussian Splatting scene, turning it into a text-queryable semantic field. However, attaching a high-dimensional feature to each of millions of Gaussians inflates a single scene to gigabytes, which makes storage and deployment the real bottleneck of these fields. Existing compact methods each learn and ship a per-scene codec, an autoencoder, a quantized codebook, or a distilled feature field, entangling field construction with field storage and never compressing the per-Gaussian assignment that holds the bulk of the cost. We argue that construction and storage should be decoupled, and that storage is a rate-distortion problem over the per-Gaussian binding to a small anchor table, a structure no prior open-vocabulary method compresses. We present CoSAG, which constructs the field without any per-scene training through a closed-form transmittance-weighted lift, spatially grounded semantic anchors, and multi-view denoising, and stores it with a spatially predictive entropy coder that ships no decoder. Because the anchors are spatially grounded, the binding is predictable and therefore highly compressible. The transmittance-weighted lift and multi-view denoising yield a clean, view-consistent assignment, so the entropy coder spends almost no rate on correcting noise and instead codes only the residual against its spatial prediction. CoSAG reaches sub-megabyte storage while matching or exceeding the state of the art across the 2D-rendered, 3D-selection, and dense-LSeg protocols, reducing field size by 37 to 76x relative to LangSplatV2 at higher accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。