arXiv:2601.05394cs.CVcs.GR2026-01被引 1

将3D高斯分为轮廓与区域两类,实现高效压缩与渐进渲染。

Sketch&Patch++: Efficient Structure-Aware 3D Gaussian Representation

  • 按结构特征分两类高斯:轮廓型捕边缘,区域型补平滑。
  • 同等模型大小下,PSNR提升1.74 dB,室内场景仅需0.5%参数。
  • 无需外部线条数据,适合移动端与低带宽环境实时渲染。

我们观察到高斯分布具有类似艺术创作中的不同角色——部分高斯捕捉高频特征如边缘和轮廓,另一些则代表低频平滑区域,类似于绘画中的笔触。基于此,我们提出一种混合表示法,将高斯分为(i)Sketch Gaussians(高频率边界特征)与(ii)Patch Gaussians(低频率平滑区域)。这种语义分离自然支持分层渐进流式传输:紧凑的Sketch Gaussians先构建结构骨架,随后Patch Gaussians逐步细化体积细节。本文扩展先前方法至任意3D场景,提出直接作用于3DGS表示的新型层次自适应分类框架,结合多准则密度聚类与自适应质量驱动优化。该方法摆脱对外部3D线段基元的依赖,确保参数编码效率最优。在包括人造与自然场景在内的多类场景中综合评估显示,本方法在等模型尺寸下相较均匀剪枝基线实现最高1.74 dB的PSNR提升、6.7%的SSIM增益与41.4%的LPIPS降低;对于室内场景,仅用0.5%原始模型规模即可保持视觉质量。该结构感知表示支持高效存储、自适应流式传输与高保真3D内容渲染,适用于带宽受限网络与资源受限设备。

原文摘要 · Abstract (English)

We observe that Gaussians exhibit distinct roles and characteristics analogous to traditional artistic techniques -- like how artists first sketch outlines before filling in broader areas with color, some Gaussians capture high-frequency features such as edges and contours, while others represent broader, smoother regions analogous to brush strokes that add volume and depth. Based on this observation, we propose a hybrid representation that categorizes Gaussians into (i) Sketch Gaussians, which represent high-frequency, boundary-defining features, and (ii) Patch Gaussians, which cover low-frequency, smooth regions. This semantic separation naturally enables layered progressive streaming, where the compact Sketch Gaussians establish the structural skeleton before Patch Gaussians incrementally refine volumetric detail. In this work, we extend our previous method to arbitrary 3D scenes by proposing a novel hierarchical adaptive categorization framework that operates directly on the 3DGS representation. Our approach employs multi-criteria density-based clustering, combined with adaptive quality-driven refinement. This method eliminates dependency on external 3D line primitives while ensuring optimal parametric encoding effectiveness. Our comprehensive evaluation across diverse scenes, including both man-made and natural environments, demonstrates that our method achieves up to 1.74 dB improvement in PSNR, 6.7% in SSIM, and 41.4% in LPIPS at equivalent model sizes compared to uniform pruning baselines. For indoor scenes, our method can maintain visual quality with only 0.5\% of the original model size. This structure-aware representation enables efficient storage, adaptive streaming, and rendering of high-fidelity 3D content across bandwidth-constrained networks and resource-limited devices.

3D高斯结构感知高效渲染压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。