仅用图像和相机位姿快速重建高质量3D场景,无需预设几何信息。
ACEsplat: Accelerated 3D Gaussian Scene Regression via RGB and Poses Only

- 通过自监督坐标回归构建内部几何先验,无需外部3D数据
- 真实机器人位姿下Wayspots数据集达29.11 dB PSNR,Cambridge Landmarks达33.20 dB
- 单卡15-25分钟完成整场重建,适合机器人与混合现实快速部署
每场景3D高斯泼溅(3DGS)可实现高保真渲染,但实际机器人与AR场景捕获常依赖外部几何初始化(如SfM点云或深度估计),在实地部署中速度慢且易出错。本文提出ACEsplat,一种仅使用RGB图像和相机位姿的快速每场景优化框架,无需外部3D先验(如预计算的SfM模型或监督深度图)。其采用两阶段流程:(1) 自监督场景坐标回归(SCR)模块在4–5分钟内建立内部几何先验;(2) 利用轻量级高斯初始化头融合SCR特征与坐标先验,随后进行每场景3DGS优化。在静态视图渲染任务中,使用真实SLAM位姿的Wayspots数据集达到29.11 dB PSNR,SfM优化位姿的Cambridge Landmarks数据集达33.20 dB。在RealEstate10K稀疏视图新视角合成任务中,2视图设置下仍保持良好图像保真度。单卡15–25分钟内完成场景特定的SCR映射与3DGS重建,适用于机器人与混合现实中的快速场景搭建。
原文摘要 · Abstract (English)
Per-scene 3D Gaussian Splatting (3DGS) enables high-fidelity rendering, but practical robotic and AR scene capture pipelines often depend on external geometric initialization (e.g., SfM point clouds or depth estimates), which can be slow and brittle in on-site deployment. We present ACEsplat, a fast per-scene optimization framework that reconstructs 3D Gaussian representations from RGB images and camera poses only, without requiring external 3D priors (e.g., precomputed SfM models or supervised depth maps). ACEsplat uses a two-stage pipeline: (1) a self-supervised scene coordinate regression (SCR) module builds an internal geometry prior within 4--5 minutes; (2) SCR features and coordinate priors are fused by a lightweight Gaussian initialization head, followed by per-scene 3DGS optimization. On static-view rendering, ACEsplat achieves 29.11 dB PSNR on Wayspots with real-time SLAM poses and 33.20 dB on Cambridge Landmarks with SfM-refined poses. On RealEstate10K sparse-view novel view synthesis, it achieves competitive image fidelity under a challenging 2-view setting. ACEsplat completes scene-specific SCR mapping and 3DGS reconstruction within 15--25 minutes on a single GPU, making it a practical RGB+pose-only solution for rapid scene setup in robotics and mixed-reality applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。