通过局部性感知优化高斯点分布,提升图像表示效率与质量
Locality-Aware Density Control for Efficient Gaussian-based Image Representation

- 利用图像空间误差连续性和高斯空间相似性指导分配
- 相同数据集下比基线高2.93dB PSNR,30k高斯点预算内表现更优
- 可插件式部署,适合需要高效图像重建的场景
2D高斯点渲染因其显式表达、快速光栅化和优异解码效率,成为图像表示的有吸引力方向。该范式的表示质量依赖于对高要求区域的高斯容量合理分配。然而现有方法在优化过程中无法高效分配高斯容量:欠重建区域常以碎片化的像素级方式优化,而属性相近的邻近高斯点被冗余保留。这种低效促使我们提出一种联合解决欠分配与过分配问题的密度控制框架。核心洞察是利用两种互补的局部性:图像空间中重建误差的局部连续性,用于优化高斯分配;高斯空间中邻近高斯点的局部相似性,用于消除冗余。基于此,我们提出局部性感知密度控制(LocoADC),采用区域级高斯增密(RGD)与相似性驱动高斯合并(SDGM)策略,并引入局部颜色一致性约束以实现更可靠的合并。在多种数据集上的大量实验表明,LocoADC始终能提升多个基线性能,实现更有效的局部高斯分配,如在相同30,000个高斯点预算下,相较GI在CLIC数据集上取得2.93 dB的PSNR提升。代码已开源。
原文摘要 · Abstract (English)
2D Gaussian Splatting is an attractive direction for image representation due to its explicit formulation, fast rasterization, and favorable decoding efficiency. The representation quality of this paradigm depends on the proper allocation of Gaussian capacity to the demanding regions. However, existing methods fail to allocate Gaussian capacity efficiently during optimization: under-reconstructed content is often refined in a fragmented pixel-wise manner, while neighboring optimized Gaussians with similar attributes are redundantly retained. This inefficiency motivates the need for a density control framework that jointly addresses insufficient allocation in under-reconstructed regions and redundant allocation in over-reconstructed regions. Our key insight is that this framework should exploit two complementary forms of locality: the local continuity of reconstruction errors in image space for improved Gaussian allocation, and the local similarity of neighboring Gaussians in Gaussian space for redundant elimination. Based on this insight, we propose Locality-Aware Density Control (LocoADC), a plug-and-play framework that improves Gaussian capacity utilization through Region-wise Gaussian Densification (RGD) and Similarity-Driven Gaussian Merging (SDGM) strategies, together with a local color consistency constraint for more reliable merging. Extensive experiments on diverse datasets show that LocoADC consistently improves multiple baselines by enabling more effective local Gaussian allocation, including a 2.93 dB PSNR gain over GI on the CLIC dataset under the same 30k Gaussian budget. Code is available at: \textit{https://github.com/ChenJiaCong-1005/LocoADC}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。