跨镜头标签迁移方法实现90%以上准确率，65毫秒完成
Transferability of labels between multilens cameras
- 结合相位相关与迭代优化，通过频域交叉相关对齐图像
- 标签转移准确率超90%，全流程仅需65毫秒
- 适用于可见光外的隐性目标标注，拓展多镜头相机应用
本文提出一种自动将边界框（BB）和掩码标签从多镜头相机不同通道间迁移的新方法。首先在频域进行交叉相关，于空间域定位强度峰值以实现图像对齐；其次通过迭代优化最大化交并比（IoU）获得最佳变换。实验表明，该方法在多数情况下标签迁移准确率超过90%，整套流程耗时仅65毫秒。获得变换后，生成人工RGB图像用于标注，并将标签信息转移至其他镜头。该技术使多镜头相机可广泛应用于非卫星或医疗领域，实现对可见光谱外物体的有效标注。
原文摘要 · Abstract (English)
In this work, a new method for automatically extending Bounding Box (BB) and mask labels across different channels on multilens cameras is presented. For that purpose, the proposed method combines the well known phase correlation method with a refinement process. During the first step, images are aligned by localizing the peak of intensity obtained in the spatial domain after performing the cross correlation process in the frequency domain. The second step consists of obtaining the best possible transformation by using an iterative process maximising the IoU (Intersection over Union) metric. Results show that, by using this method, labels could be transferred across different lens on a camera with an accuracy over 90% in most cases and just by using 65 ms in the whole process. Once the transformations are obtained, artificial RGB images are generated, for labeling them so as to transfer this information into each of the other lens. This work will allow users to use this type of cameras in more fields rather than satellite or medical imagery, giving the chance of labeling even invisible objects in the visible spectrum.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。