多鱼眼相机提升视觉惯性定位精度,抗遮挡且实时高效。
MFVINS: Multiple Fisheye Camera-Based Visual Inertial System

- 多鱼眼相机+IMU融合,用改进特征追踪增强鲁棒性。
- 引入物理有效性约束的重投影误差,提升位姿估计准确性。
- 实现实时运行,适合复杂环境下的低成本定位系统。
基于单目相机与低成本惯性测量单元(IMU)的同步定位与地图构建(SLAM)是一种经济有效的传感器配置。视觉惯性系统(VINS)通过融合相机与IMU数据,估计传感器六自由度(DOF)位姿。传统VINS仅使用单个相机作为视觉输入,在遮挡、光照变化和无纹理环境中易出现误差累积。本文提出一种新型多鱼眼相机视觉惯性系统(MFVINS),设计了基于IMU辅助的FAST特征追踪器,实现多相机下高效特征提取与鲁棒匹配;提出在归一化图像平面上滤除鱼眼畸变导致的异常点;进一步设计基于学习深度估计的、带物理有效性约束的新重投影误差,用于束调整。所提方法在多种场景中验证有效,相较于现有VINS方法显著提升性能。特别地,MFVINS实现了实时处理,充分利用多相机优势——对遮挡和无纹理区域具有更强鲁棒性,同时降低计算开销。
原文摘要 · Abstract (English)
A simultaneous localization and mapping (SLAM) method using a monocular camera and a low-cost inertial measurement unit (IMU) sensor is an effective way to fulfill a low-cost sensor configuration. Using this sensor configuration, visual-inertial system (VINS) focuses on fusing data from a camera and an IMU sensor to estimate the six degrees-of-freedom (DOF) of the sensor pose. Typically, VINS uses only a single camera as visual input, which lead to problems such as error accumulation due to occlusion, various illumination, and textureless environments. In this paper, we propose a new multiple fisheye camera-based visual-inertial system called MFVINS. We present an IMU-aided FAST feature tracker for multiple cameras that enables efficient extraction and robust matching of local features. Then, the proposed method filters out outliers caused by fisheye distortion on the normalized image plane. Subsequently, a new reprojection error with physical validity constraints is proposed for bundle adjustment using learning-based depth estimation. The proposed method is applied to various scenarios, and its effectiveness is demonstrated by comparing previous VINS methods. In particular, MFVINS is implemented in real-time process to leverage the advantages of using multiple cameras -- robustness against occlusion and textureless regions -- while reducing the computational burden.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。