arXiv:2606.05102cs.CV2026-06

用分组令牌减少高斯数量,让3D重建更高效

ZipSplat: Fewer Gaussians, Better Splats

论文配图:ZipSplat: Fewer Gaussians, Better Splats
图 1 · 摘自论文原文
  • 用聚类提取场景令牌,不再按像素分配高斯
  • 仅需原方法1/6的高斯数,仍保持更优画质
  • 无需真实相机参数,跨数据集零样本通用

前向式3D高斯点云重建方法通常为每张输入图像的每个像素预测一个高斯,导致表示预算与相机分辨率绑定,无法根据场景复杂度动态调整。平坦墙面与纹理丰富的物体生成相同数量的高斯,造成资源浪费。本文提出ZipSplat,一种基于令牌的前向模型,将高斯分布与像素网格解耦。多视图主干提取密集视觉令牌,通过k-means聚类压缩为精简的场景令牌集合。交叉与自注意力机制优化这些令牌,轻量MLP将其解码为具有任意3D位置的一组高斯。由于聚类在推理阶段进行,单一训练模型即可覆盖质量-效率权衡曲线,无需重新训练。ZipSplat无需真值位姿或内参,但在DL3DV和RealEstate10K上以约6倍更少的高斯数达到新最佳性能,分别优于最佳无位姿基线2.1dB和1.2dB PSNR。同时在Mip-NeRF360和ScanNet++上实现零样本泛化,超越所有可比基线。

原文摘要 · Abstract (English)

Feed-forward 3D Gaussian Splatting methods reconstruct a scene from posed or pose-free images in a single forward pass, yet current approaches predict one Gaussian per input pixel, tying the representation budget to camera resolution rather than scene complexity. A flat wall and a richly textured object thus produce equally many Gaussians despite very different geometric needs. We propose ZipSplat, a token-based feed-forward model that decouples Gaussian placement from the pixel grid. A multi-view backbone extracts dense visual tokens, and k-means clustering compresses them into a compact set of scene tokens. Cross- and self-attention refine these tokens, and a lightweight MLP decodes each into a group of Gaussians with unconstrained 3D positions. Because clustering is applied at inference, a single trained model spans the quality-efficiency curve without retraining. ZipSplat operates without ground-truth poses or intrinsics, yet sets a new state of the art on DL3DV and RealEstate10K with ${\sim}6{\times}$ fewer Gaussians than pixel-aligned methods, surpassing the best pose-free baseline by 2.1dB and 1.2dB PSNR, respectively. It further generalizes zero-shot to Mip-NeRF360 and ScanNet++, outperforming all comparable baselines. Our project page is at https://veichta.com/zipsplat.

3D重建高斯点云效率优化无位姿

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。