利用无人机IMU数据提升航拍图像拼接精度与稳定性
Aerial Image Stitching Using IMU Data from a UAV
- 结合IMU姿态数据与视觉算法,先校正位移和旋转
- 在大角度变化下仍保持拼接准确,优于传统特征匹配方法
- 适合需要高鲁棒性的航拍拼接场景,如复杂地形
无人机广泛应用于航拍与遥感。将多张图像拼接为覆盖大范围的高分辨率图像是一大挑战。基于特征的拼接算法常因特征检测与匹配错误而失效。为此,本文提出一种新方法:融合无人机惯性测量单元(IMU)数据与计算机视觉技术。该方法包括估计连续图像间的位移与旋转、校正透视畸变、计算单应性矩阵,并采用标准图像拼接算法对齐与融合图像。所提方法利用IMU提供的额外信息,有效纠正多种畸变,可无缝集成至现有无人机工作流程。实验表明,该方法在大位移、大旋转及相机姿态变化等复杂场景中,显著提升了拼接的准确性与可靠性,优于部分现有基于特征的拼接算法。
原文摘要 · Abstract (English)
Unmanned Aerial Vehicles (UAVs) are widely used for aerial photography and remote sensing applications. One of the main challenges is to stitch together multiple images into a single high-resolution image that covers a large area. Featurebased image stitching algorithms are commonly used but can suffer from errors and ambiguities in feature detection and matching. To address this, several approaches have been proposed, including using bundle adjustment techniques or direct image alignment. In this paper, we present a novel method that uses a combination of IMU data and computer vision techniques for stitching images captured by a UAV. Our method involves several steps such as estimating the displacement and rotation of the UAV between consecutive images, correcting for perspective distortion, and computing a homography matrix. We then use a standard image stitching algorithm to align and blend the images together. Our proposed method leverages the additional information provided by the IMU data, corrects for various sources of distortion, and can be easily integrated into existing UAV workflows. Our experiments demonstrate the effectiveness and robustness of our method, outperforming some of the existing feature-based image stitching algorithms in terms of accuracy and reliability, particularly in challenging scenarios such as large displacements, rotations, and variations in camera pose.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。