用2D高斯点拟合大图像,实现高质量快速重建。
Large Images are Gaussians: High-Quality Large Image Representation with Levels of 2D Gaussian Splatting
- 采用改进的表示与优化策略,支持大量高斯点拟合。
- 分层高斯重建实现低频粗结构与高频细节同步恢复。
- 适合需要快速高质量大图重建的视觉任务应用。
隐式神经表示(INRs)在图像表示中表现优异,但存在训练内存占用大、解码速度慢的问题。近年来,高斯点渲染(GS)因其高质量的新视角合成与快速渲染能力,在3D重建中崭露头角。其中,基于GS的2DGS方法已展现出图像拟合潜力。本文提出大型图像即高斯点(LIG),深入探索2DGS在图像表示中的应用,针对大量高斯点拟合大图像的挑战,提出两项改进:1)采用一种变体表示与优化策略,提升大规模高斯点的拟合能力;2)提出分层高斯(Level-of-Gaussian)机制,分别重建低频粗结构与高频细节。实验表明,该方法成功将大图像表示为高斯点集合,并在多种类型的大图像上实现了高质量重建。代码已开源。
原文摘要 · Abstract (English)
While Implicit Neural Representations (INRs) have demonstrated significant success in image representation, they are often hindered by large training memory and slow decoding speed. Recently, Gaussian Splatting (GS) has emerged as a promising solution in 3D reconstruction due to its high-quality novel view synthesis and rapid rendering capabilities, positioning it as a valuable tool for a broad spectrum of applications. In particular, a GS-based representation, 2DGS, has shown potential for image fitting. In our work, we present \textbf{L}arge \textbf{I}mages are \textbf{G}aussians (\textbf{LIG}), which delves deeper into the application of 2DGS for image representations, addressing the challenge of fitting large images with 2DGS in the situation of numerous Gaussian points, through two distinct modifications: 1) we adopt a variant of representation and optimization strategy, facilitating the fitting of a large number of Gaussian points; 2) we propose a Level-of-Gaussian approach for reconstructing both coarse low-frequency initialization and fine high-frequency details. Consequently, we successfully represent large images as Gaussian points and achieve high-quality large image representation, demonstrating its efficacy across various types of large images. Code is available at {\href{https://github.com/HKU-MedAI/LIG}{https://github.com/HKU-MedAI/LIG}}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。