arXiv:2412.16431cs.CVcs.AI2024-12中稿 · 2024 IEEE Internat…被引 1

用YOLOv8检测手部图像,提升司法鉴定效率。

Object Detection Approaches to Identifying Hand Images with High Forensic Values

  • 用YOLOv8和视觉变换器对比检测手部,优化标注流程。
  • YOLOv8n和YOLOv8x在四个数据集上均优于DETR和DETA。
  • 可快速识别高价值司法手部图像,适合实战应用。

法医学在法律调查中至关重要,基于机器学习的物体检测技术可提升分析效率与准确性。人类手部具有独特性,常留下可识别的纹路、痕迹或印痕,可用于司法检验。本文比较了多种机器学习手部检测方法,并展示了最优模型在司法场景中识别高价值图像的应用效果。我们在包含11,000张手部图像的数据集(由半自动标注生成边界框)及其他三个数据集上,微调了YOLOv8 nano(YOLOv8n)、YOLOv8 extra-large(YOLOv8x)、DEtection TRansformer(DETR)和Detection Transformers with Assignment(DETA)四种模型。实验表明,所有数据集上YOLOv8模型均优于DETR与DETA;且相比基于YOLOv3和YOLOv4的方法,其性能更优。将微调后的YOLOv8模型应用于识别具有高司法价值的手部图像(或视频帧),取得显著成效,大幅缩短了司法专家处理时间,证明该方法可在法医学等实际场景中有效部署。

原文摘要 · Abstract (English)

Forensic science plays a crucial role in legal investigations, and the use of advanced technologies, such as object detection based on machine learning methods, can enhance the efficiency and accuracy of forensic analysis. Human hands are unique and can leave distinct patterns, marks, or prints that can be utilized for forensic examinations. This paper compares various machine learning approaches to hand detection and presents the application results of employing the best-performing model to identify images of significant importance in forensic contexts. We fine-tune YOLOv8 and vision transformer-based object detection models on four hand image datasets, including the 11k hands dataset with our own bounding boxes annotated by a semi-automatic approach. Two YOLOv8 variants, i.e., YOLOv8 nano (YOLOv8n) and YOLOv8 extra-large (YOLOv8x), and two vision transformer variants, i.e., DEtection TRansformer (DETR) and Detection Transformers with Assignment (DETA), are employed for the experiments. Experimental results demonstrate that the YOLOv8 models outperform DETR and DETA on all datasets. The experiments also show that YOLOv8 approaches result in superior performance compared with existing hand detection methods, which were based on YOLOv3 and YOLOv4 models. Applications of our fine-tuned YOLOv8 models for identifying hand images (or frames in a video) with high forensic values produce excellent results, significantly reducing the time required by forensic experts. This implies that our approaches can be implemented effectively for real-world applications in forensics or related fields.

目标检测司法鉴定YOLOv8手部识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。