提出新方法优化3D语义占用中高斯点的分配,提升精度与效率。
Learning Adaptive Semantic Gaussian Allocation for 3D Occupancy

- 基于属性与局部特征评分,动态选择最优高斯点集
- 减少冗余点,增强困难区域的语义支持,降低语义混淆
- 适合需要高效语义3D建模的自动驾驶场景
语义3D高斯通过在体素空间中渲染语义基元并接受体素级监督,提供紧凑的3D语义占用表示。现有方法通过更灵活的基元形状、几何引导初始化和渐进式稠密化提升了建模能力与效率。然而这些进展主要关注基元如何表示、初始化或添加,未显式解决在总数量受限时如何选择最有用的高斯点。这种不平衡导致分配瓶颈:简单区域残留冗余高斯点,而复杂区域缺乏足够的语义支持。本文提出语义高斯分配变压器(SAGFormer),利用高斯属性与局部几何-语义特征对候选点进行评分,选出固定数量的最终高斯集。在nuScenes-SurroundOcc和SSCBench-KITTI-360上的实验表明,SAGFormer在评估协议下提升了占用预测性能,生成了更语义一致且利用率更高的高斯表示。在相似最终数量与原始覆盖度下,其降低了语义混杂,增强了类别一致的体素支持,并减少了未使用高斯点。结果表明,显式的容量分配是语义占用预测中高斯精炼的有效补充。
原文摘要 · Abstract (English)
Semantic 3D Gaussians provide a compact representation for 3D semantic occupancy prediction by rendering semantic primitives into a voxel volume under voxel-wise supervision. Recent methods have improved the modeling ability and efficiency of this representation through more flexible primitive shapes, geometry-guided initialization, and progressive densification. However, these advances mainly determine how primitives are represented, initialized, or added, and do not explicitly address how to select the most useful Gaussians when their total number must be limited to control memory and computation. This imbalance creates an allocation bottleneck: redundant Gaussians remain in simple regions, while difficult regions receive insufficient semantic support. We propose the Semantic Gaussian Allocation Transformer (SAGFormer), which uses Gaussian attributes and local geometric-semantic features to score candidates and select a fixed final Gaussian set. Experiments on nuScenes-SurroundOcc and SSCBench-KITTI-360 show that SAGFormer improves occupancy prediction under the evaluated protocols and yields more semantically consistent and better-utilized Gaussian representations. Under similar final counts and raw coverage, it reduces semantic mixing, strengthens class-consistent voxel support, and produces fewer unused Gaussians. The results indicate that explicit capacity allocation is a useful complement to Gaussian refinement for semantic occupancy prediction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。