arXiv:2505.23734cs.CV2025-05NeurIPS被引 29

让3D高斯点云模型轻松处理超百张输入视图,不占显存还能提质量。

ZPressor: Bottleneck-Aware Compression for Scalable Feed-Forward 3DGS

  • 用跨视角注意力压缩多视图信息,生成紧凑隐状态Z
  • 在80GB显存上支持480P下100+视图输入,性能不降
  • 适配主流3DGS模型,适合做大规模新视角合成的开发者

前馈式3D高斯点云(3DGS)模型近年成为新视角合成的有前景方案,支持单次推理而无需每场景优化。但其可扩展性受限于模型容量,随着输入视图增多,性能下降或显存消耗剧增。本文基于信息瓶颈原理分析前馈3DGS框架,提出ZPressor——一个轻量、架构无关的压缩模块,可将多视图输入高效压缩为紧凑隐状态Z,保留关键场景信息并去除冗余。具体地,通过将视图分为锚点与支持集,利用交叉注意力将支持视图信息压缩至锚点视图,形成压缩后的隐状态Z。实验表明,集成ZPressor后,现有先进前馈3DGS模型在中等输入视图下性能一致提升,在两个大规模基准DL3DV-10K和RealEstate10K的密集视图设置下显著增强鲁棒性。视频、代码与训练模型已公开于项目页:https://lhmd.top/zpressor。

原文摘要 · Abstract (English)

Feed-forward 3D Gaussian Splatting (3DGS) models have recently emerged as a promising solution for novel view synthesis, enabling one-pass inference without the need for per-scene 3DGS optimization. However, their scalability is fundamentally constrained by the limited capacity of their models, leading to degraded performance or excessive memory consumption as the number of input views increases. In this work, we analyze feed-forward 3DGS frameworks through the lens of the Information Bottleneck principle and introduce ZPressor, a lightweight architecture-agnostic module that enables efficient compression of multi-view inputs into a compact latent state $Z$ that retains essential scene information while discarding redundancy. Concretely, ZPressor enables existing feed-forward 3DGS models to scale to over 100 input views at 480P resolution on an 80GB GPU, by partitioning the views into anchor and support sets and using cross attention to compress the information from the support views into anchor views, forming the compressed latent state $Z$. We show that integrating ZPressor into several state-of-the-art feed-forward 3DGS models consistently improves performance under moderate input views and enhances robustness under dense view settings on two large-scale benchmarks DL3DV-10K and RealEstate10K. The video results, code and trained models are available on our project page: https://lhmd.top/zpressor.

3D高斯图像生成压缩可扩展

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。