解决3D高斯泼溅在无纹理场景下的跟踪失效问题
Spectral GS-SLAM: Observability-Aware, Degeneracy-Robust Tracking for Real-Time 3D Gaussian Splatting SLAM

- 融合ICP与特征点约束,动态补偿退化场景中的不完整方向
- 实测达40.14帧/秒,在无结构和无纹理环境稳定运行
- 适合需要高鲁棒性实时3D重建的科研与工程应用
近期的3DGS-SLAM系统通过采用传统特征匹配或基于ICP的跟踪实现实时运算,避免了早期方法中繁重的密集光度优化。然而,特征匹配在无纹理环境中易失效,而基于ICP的跟踪在结构缺失或几何退化场景中因优化条件不佳而表现不佳。为此,我们提出Spectral GS-SLAM,一种高效且鲁棒的跟踪框架,将ICP与互补的特征基约束相结合。该方法通过自适应补偿退化场景中的欠约束方向,缓解数值不稳定性,且不干扰用于建图的共享高斯表示。我们进一步引入高斯感知的平面性加权机制,利用3D高斯的固有协方差结构刻画场景几何并指导信息融合。在具有挑战性的TUM RGB-D序列上的大量评估表明,Spectral GS-SLAM实现了40.14帧/秒的实时性能,并在无结构和无特征环境中保持一致的跟踪效果。所提方法在退化场景中维持轨迹完整性,同时在非不利条件下保持竞争力。
原文摘要 · Abstract (English)
Recent 3DGS-SLAM systems enable real-time operation by leveraging conventional feature matching or ICP-based tracking, thereby avoiding the heavy dense photometric optimization used in earlier approaches. However, feature matching remains prone to failure in textureless environments, while ICP-based tracking struggles in structureless or geometrically degenerate scenes due to ill-conditioned optimization. To address this issue, we propose Spectral GS-SLAM, an efficient yet robust tracking framework that integrates ICP with complementary feature-based constraints. Our method mitigates numerical instability by adaptively compensating under-constrained directions in degenerate scenarios, without interfering with the shared Gaussian representation used for mapping. We further introduce a Gaussian-aware planarity weighting mechanism that exploits the intrinsic covariance structure of 3D Gaussians to characterize scene geometry and guide information fusion. Extensive evaluations on challenging TUM RGB-D sequences demonstrate that Spectral GS-SLAM achieves real-time performance (40.14 FPS) while maintaining consistent tracking in both structureless and featureless environments. The proposed method preserves trajectory integrity in degenerate scenes while maintaining competitive performance in non-adverse conditions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。