QuerySplat通过解耦几何与外观表示,实现更清晰的3D高保真渲染。
QuerySplat: Decoupling Geometry and Appearance Representations in 3DGS Prediction

- 用双分支查询解码器,几何分支依赖预训练视觉几何模型,外观分支独立恢复细节。
- 在DL3DV基准上,相比最佳无姿态基线提升2.30 dB PSNR,优于有姿态基线1.04 dB。
- 适合关注3D重建质量、尤其需要无姿态鲁棒性的研究者或应用开发人员。
尽管前馈式3D高斯点云(3DGS)能实现高效3D重建,但高质量渲染仍具挑战。现有像素对齐方法存在空间刚性与结构冗余问题,而查询式方法缺乏3D先验且几何与外观耦合,导致图像模糊且依赖视角。为此,我们提出QuerySplat,一种基于几何先验与显式外观解耦的前馈3DGS框架。设计双分支查询解码器:几何分支利用预训练视觉几何模型实现空间理解,天然具备无姿态建模能力;外观分支通过独立路径恢复高频细节,避免与几何属性回归混淆。大量实验表明,QuerySplat缓解了早期查询式方法的模糊问题,在渲染保真度上持续优于像素对齐方法。在具有挑战性的DL3DV基准上,其新视角合成性能达到当前最优,平均PSNR分别比最佳无姿态和需姿态基线提升2.30 dB与1.04 dB。
原文摘要 · Abstract (English)
While feed-forward 3D Gaussian Splatting (3DGS) enables efficient 3D reconstruction, achieving high-fidelity rendering remains challenging. Existing pixel-aligned approaches suffer from spatial inflexibility and massive structural redundancy, whereas query-based methods lack 3D priors and entangle geometry with appearance, yielding blurry, pose-dependent results. To overcome these deficiencies, we propose \textbf{QuerySplat}, a feed-forward 3DGS framework driven by geometric priors and explicit appearance decoupling. Specifically, we design a dual-branch query-based decoder: the geometry branch leverages a pretrained Vision Geometric Model for spatial understanding, which intrinsically endows QuerySplat with pose-free modeling capabilities, while the appearance branch recovers high-frequency details through a dedicated pathway separated from geometric attribute regression. Extensive experiments demonstrate that QuerySplat mitigates the blurry rendering issues of early query-based models and consistently outperforms pixel-aligned approaches in rendering fidelity. On the challenging DL3DV benchmark, it achieves state-of-the-art novel view synthesis performance, with average PSNR gains of 2.30 dB and 1.04 dB over the best pose-free and pose-required baselines, respectively. Project Page: https://inspatio.github.io/querysplat.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。