arXiv:2607.20417cs.CV2026-07

让3D高斯泼溅更紧凑高效,自动聚焦复杂区域

ATSplat: Compact Feed-forward 3D Gaussian Splatting with Adaptive Token Expansion

论文配图:ATSplat: Compact Feed-forward 3D Gaussian Splatting with Adaptive Token Expansion
图 1 · 摘自论文原文
  • 用自适应3D令牌替代像素对齐的高斯,实现稀疏到动态扩展
  • 仅用31.1万高斯实现1136帧/秒渲染,比现有方法少5.7倍
  • 适合追求实时渲染与轻量化3D重建的开发者

3D高斯泼溅通过在3D空间优化自由分布的基元并自适应地在欠重建区域增加密度,实现高质量新视角合成。然而,现有前馈式3DGS方法大多在输入像素处回归高斯,并沿相机射线提升,导致基元数量和位置依赖图像分辨率与视角,而非场景复杂度,造成密集且冗余的高斯集合。我们提出ATSplat,一种恢复3DGS优化自适应分配能力的前馈框架,通过自适应3D令牌实现。首先将粗粒度的块级深度与相机线索提升为稀疏3D锚点,构建场景紧凑骨架;每个锚点再通过可学习3D偏移回归为局部高斯,解耦基元布局与输入图像网格。自适应令牌扩展模块基于渲染误差图监督,预测令牌不确定性,并通过可学习扩展层选择性扩展高不确定性令牌。这种稀疏到自适应的范式使模型能集中基元于挑战区域,同时保持紧凑表示。在RealEstate10K和DL3DV两个数据集上的实验表明,ATSplat在减少超过5.7倍高斯数量的同时达到最先进渲染质量。从12张512×960分辨率输入图像出发,单张商用GPU可在不到1秒内完成重建,并以311K高斯实现1136帧/秒(512×960)高质量新视角渲染。

原文摘要 · Abstract (English)

3D Gaussian Splatting (3DGS) achieves high-quality novel-view synthesis by optimizing freely placed primitives in 3D and adaptively densifying them in under-reconstructed regions. However, this scene-adaptive capacity allocation is largely lost in existing feed-forward 3DGS methods, which commonly regress Gaussians at input pixels and lift them along camera rays. Such pixel-aligned formulations make the number and placement of primitives depend on image resolution and input viewpoints rather than scene complexity, resulting in dense and often redundant Gaussian sets. We present ATSplat, a feed-forward 3DGS framework that restores the adaptive allocation capability of 3DGS optimization through Adaptive 3D Tokens. ATSplat first lifts coarse patch-level depth and camera cues into sparse 3D anchor tokens, forming a compact scaffold of the scene. Each token is then regressed into local Gaussians with learnable 3D offsets, decoupling primitive placement from input image grids. An Adaptive Token Expansion module predicts a token-level uncertainty score, supervised by rendering error maps, and selectively expands high-uncertainty tokens through learnable expansion layers. This sparse-to-adaptive formulation enables ATSplat to concentrate primitives in challenging regions while maintaining a compact representation. Experiments on two representative datasets, RealEstate10K and DL3DV, show that ATSplat achieves state-of-the-art rendering quality while reducing the number of Gaussians by more than $5.7\times$ compared with dense feed-forward 3DGS methods. From 12 input images at $512 \times 960$ resolution, ATSplat completes reconstruction in less than a second using a single commercial GPU, and renders high-quality novel views at 1136 FPS ($512 \times 960$) with only 311K Gaussians.

3D重建高斯泼溅实时渲染轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。