无需初始位姿即可实现多机器人3D地图精准融合,靠语义信息自动对齐。
SIREN: Semantic, Initialization-Free Registration of Multi-Robot Gaussian Splatting Maps
- 用语义识别关键区域,免去传统方法需要的初始化步骤。
- 通过语义匹配高斯点,实现粗略对齐,误差比基线小90倍以上。
- 结合新视角合成与语义滤波,生成高保真融合地图,适合真实机器人场景。
我们提出SIREN,用于多机器人高斯点云(GSplat)地图的注册,无需相机位姿、图像或子地图间变换作为初始化或融合输入。为实现此目标,SIREN在三个关键环节中利用语义的丰富性与鲁棒性,构建严谨的注册流程:首先,利用语义识别局部地图中特征丰富的区域,使注册问题更易求解,从而消除对初始化的需求;其次,基于鲁棒的语义特征识别各地图中高斯点之间的候选对应关系,构成几何优化的基础,实现子地图中3D高斯原语的粗略对齐;第三,此关键步骤支持后续光度精修,SIREN利用GSplat中的新视角合成技术,并结合语义图像滤波,计算出高精度非刚性变换,生成高保真融合地图。我们在多个真实世界数据集上验证了SIREN优于现有基线的表现,尤其在最广泛使用的机器人平台(包括机械臂、无人机和四足机器人)上表现突出。实验表明,在最具挑战性的场景中,相比竞品方法,SIREN的旋转误差降低约90倍,平移误差降低300倍,尺度误差降低44倍。代码将在评审后开源。
原文摘要 · Abstract (English)
We present SIREN for registration of multi-robot Gaussian Splatting (GSplat) maps, with zero access to camera poses, images, and inter-map transforms for initialization or fusion of local submaps. To realize these capabilities, SIREN harnesses the versatility and robustness of semantics in three critical ways to derive a rigorous registration pipeline for multi-robot GSplat maps. First, SIREN utilizes semantics to identify feature-rich regions of the local maps where the registration problem is better posed, eliminating the need for any initialization which is generally required in prior work. Second, SIREN identifies candidate correspondences between Gaussians in the local maps using robust semantic features, constituting the foundation for robust geometric optimization, coarsely aligning 3D Gaussian primitives extracted from the local maps. Third, this key step enables subsequent photometric refinement of the transformation between the submaps, where SIREN leverages novel-view synthesis in GSplat maps along with a semantics-based image filter to compute a high-accuracy non-rigid transformation for the generation of a high-fidelity fused map. We demonstrate the superior performance of SIREN compared to competing baselines across a range of real-world datasets, and in particular, across the most widely-used robot hardware platforms, including a manipulator, drone, and quadruped. In our experiments, SIREN achieves about 90x smaller rotation errors, 300x smaller translation errors, and 44x smaller scale errors in the most challenging scenes, where competing methods struggle. We will release the code and provide a link to the project page after the review process.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。