用YOLO和孪生网络自动筛选高质量图像,提升数据收集效率与精度。
Development of Image Collection Method Using YOLO and Siamese Network
- 先用YOLOv10粗筛图像,再用孪生网络根据相似度精排。
- 联合模型F1值达0.772,较单一模型提升14%以上。
- 支持设置阈值平衡准确率与噪声容忍度,适合资源有限的团队。
进入大数据时代,高质量数据收集至关重要。人工收集耗时且成本高,因此学者们提出计算机辅助方法。其中网络爬虫虽常用,但易混入无关数据。本文利用YOLOv10进行初步筛选,仍存在误筛问题。为此引入孪生网络,基于图像间距离输出进行二次重分类,显著提升性能(平均F1得分从0.678提升至0.772)。用户可自定义距离阈值,灵活调节数据缺失与抗噪性之间的平衡。此外,因在孪生网络中使用裁剪后图像进行识别,资源消耗更低:以MobileNetV3-Small为例,采用裁剪预处理后类别平均F1得分由80.94提升至82.31。该双阶段系统有效减少错误,节省人力物力,更快构建高质量数据集。
原文摘要 · Abstract (English)
As we enter the era of big data, collecting high-quality data is very important. However, collecting data by humans is not only very time-consuming but also expensive. Therefore, many scientists have devised various methods to collect data using computers. Among them, there is a method called web crawling, but the authors found that the crawling method has a problem in that unintended data is collected along with the user. The authors found that this can be filtered using the object recognition model YOLOv10. However, there are cases where data that is not properly filtered remains. Here, image reclassification was performed by additionally utilizing the distance output from the Siamese network, and higher performance was recorded than other classification models. (average \_f1 score YOLO+MobileNet 0.678->YOLO+SiameseNet 0.772)) The user can specify a distance threshold to adjust the balance between data deficiency and noise-robustness. The authors also found that the Siamese network can achieve higher performance with fewer resources because the cropped images are used for object recognition when processing images in the Siamese network. (Class 20 mean-based f1 score, non-crop+Siamese(MobileNetV3-Small) 80.94 -> crop preprocessing+Siamese(MobileNetV3-Small) 82.31) In this way, the image retrieval system that utilizes two consecutive models to reduce errors can save users' time and effort, and build better quality data faster and with fewer resources than before.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。