多鱼眼相机融合定位,提升自动驾驶系统精度与鲁棒性。
Multi-LVI-SAM: A Robust LiDAR-Visual-Inertial Odometry for Multiple Fisheye Cameras
- 构建全景视觉特征模型,统一多鱼眼相机观测为单一表示。
- 提出外参补偿方法,显著降低特征不一致导致的定位误差。
- 在多个公开数据集上表现优于现有系统,适合复杂场景定位。
我们提出一种多鱼眼相机的激光雷达-视觉-惯性里程计框架(Multi-LVI-SAM),融合多鱼眼相机、激光雷达和惯性传感器数据,实现高精度且鲁棒的状态估计。为高效一致地整合多鱼眼相机的视觉信息,引入全景视觉特征模型,将多视角观测统一为单一表示,作为全局几何优化框架,整合多视图约束,实现无缝回环闭合与全局位姿优化,同时简化系统设计,避免对单个相机重复处理。针对各相机坐标系与全景模型坐标系不一致导致的三角化误差,提出外参补偿方法,提升跨视角特征一致性,显著降低三角化与优化误差,从而提高位姿估计精度。将全景视觉特征模型集成到基于因子图的紧耦合激光雷达-视觉-惯性系统中。在多个公开数据集上的大量实验表明,该模型提升了多相机约束的质量与一致性,使系统精度与鲁棒性优于现有方法。
原文摘要 · Abstract (English)
We propose a multi-camera LiDAR-visual-inertial odometry framework, Multi-LVI-SAM, which fuses data from multiple fisheye cameras, LiDAR and inertial sensors for highly accurate and robust state estimation. To enable efficient and consistent integration of visual information from multiple fisheye cameras, we introduce a panoramic visual feature model that unifies multi-camera observations into a single representation. The panoramic model serves as a global geometric optimization framework that consolidates multi-view constraints, enabling seamless loop closure and global pose optimization, while simplifying system design by avoiding redundant handling of individual cameras. To address the triangulation inconsistency caused by the misalignment between each camera's frame and the panoramic model's frame, we propose an extrinsic compensation method. This method improves feature consistency across views and significantly reduces triangulation and optimization errors, leading to more accurate pose estimation. We integrate the panoramic visual feature model into a tightly coupled LiDAR-visual-inertial system based on a factor graph. Extensive experiments on public datasets demonstrate that the panoramic visual feature model enhances the quality and consistency of multi-camera constraints, resulting in higher accuracy and robustness than existing multi-camera LiDAR-visual-inertial systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。