用单目图像和AIS数据融合生成船舶6维姿态数据集,无需人工标注。
Fusing Monocular RGB Images with AIS Data to Create a 6D Pose Estimation Dataset for Marine Vessels
- 通过YOLOX-X检测图像中的船体,结合AIS数据构建3D边界框
- PnP方法投影误差显著低于透视变换,mAP达0.80(IoU=0.5)
- 生成公开数据集BONK-pose,含3753张带3D标注的图像
本文提出一种新方法,通过融合单目RGB图像与自动识别系统(AIS)数据,构建用于海上船舶6维姿态估计的数据集。该方法克服了仅依赖AIS导致的位置信息不可靠问题,如设备故障、数据篡改和传输延迟。利用目标检测网络YOLOX-X从图像中检测船体,结合AIS消息生成代表船舶空间与旋转状态的3D边界框。评估不同检测模型并比较两种坐标对齐方法:单应性变换与透视- n-点(PnP)。结果表明,PnP方法投影误差显著低于以往方法;YOLOX-X在相关船类上达到0.80的平均精度(mAP),IoU阈值为0.5。本方法可实现无须人工标注的6维姿态数据集构建。此外,我们发布了公开数据集BONK-pose,包含3753张图像及对应的3D边界框标注,可用于训练与评估6维姿态估计网络。同时提供同场景下1000张带2D边界框的船体检测数据。
原文摘要 · Abstract (English)
The paper presents a novel technique for creating a 6D pose estimation dataset for marine vessels by fusing monocular RGB images with Automatic Identification System (AIS) data. The proposed technique addresses the limitations of relying purely on AIS for location information, caused by issues like equipment reliability, data manipulation, and transmission delays. By combining vessel detections from monocular RGB images, obtained using an object detection network (YOLOX-X), with AIS messages, the technique generates 3D bounding boxes that represent the vessels' 6D poses, i.e. spatial and rotational dimensions. The paper evaluates different object detection models to locate vessels in image space. We also compare two transformation methods (homography and Perspective-n-Point) for aligning AIS data with image coordinates. The results of our work demonstrate that the Perspective-n-Point (PnP) method achieves a significantly lower projection error compared to homography-based approaches used before, and the YOLOX-X model achieves a mean Average Precision (mAP) of 0.80 at an Intersection over Union (IoU) threshold of 0.5 for relevant vessel classes. We show indication that our approach allows the creation of a 6D pose estimation dataset without needing manual annotation. Additionally, we introduce the Boats on Nordelbe Kehrwieder (BONK-pose), a publicly available dataset comprising 3753 images with 3D bounding box annotations for pose estimation, created by our data fusion approach. This dataset can be used for training and evaluating 6D pose estimation networks. In addition we introduce a set of 1000 images with 2D bounding box annotations for ship detection from the same scene.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。