用AI自动检测各种光学条件下模糊粒子图像,精度高且适用广。
DefocusTrackerAI -- A Generalized Framework for the Automatic Detection of Defocused Particle Images

- 基于YOLOv9模型,从合成数据中学习模糊粒子定位。
- 在高密度场景下召回率更高,定位误差仅0.1–0.4像素。
- 可拓展至喷雾、液滴追踪,适合多种真实实验场景。
本文提出DefocusTrackerAI,一种通用深度学习框架,可自动检测任意光学配置下的模糊粒子图像,兼顾不确定性与召回率,是开源项目DefocusTracker的后续。通过对比Faster R-CNN与YOLOv9,选用后者在包含球差与非球差模糊粒子的多样合成图像上训练。评估显示,YOLOv9在高粒子密度下召回率更高、不确定性更低,空间分辨率提升,当粒子密度N_s ≤ 0.5时,不确定性为0.1–0.4像素,优于现有方法。模型可在多种光照和光学设置下识别模糊粒子,成功应用于真实DPT实验(包括荧光与阴影成像),扩展至喷雾与液滴追踪。基于YOLOv9的预训练版本已开源,支持高精度自动检测,结合深度标定后可实现三维离焦粒子追踪。
原文摘要 · Abstract (English)
The present work introduces DefocusTrackerAI, a generalized deep-learning framework for the automatic detection and position estimation of defocused particle images from any kind of optical configuration without compromising uncertainty and recall, intended as a follow-up of the open-source project DefocusTracker. We selected the deep neural network architecture from the direct comparison of two well-known object detection models, Faster R-CNN and YOLOv9, trained on a diverse and feature-rich synthetic image set containing astigmatic and non-astigmatic defocused particle images of varying diameters. The model evaluation on synthetic data showed that, first, YOLOv9 outperforms Faster R-CNN, achieving higher recall and lower uncertainty, particularly at high particle image densities; and second, that YOLOv9 provides enhanced spatial resolution, with uncertainty values between 0.1 and 0.4 pixels for particle image densities N_s up to 0.5, outperforming state-of-the-art algorithms. We demonstrated that our models are able to detect astigmatic and non-astigmatic defocused particle images in multiple optical setups with varying lighting conditions. In addition, we successfully applied our models on real DPT experiments, including fluorescence and shadowgraph data, showing that they can be used beyond conventional DPT applications, including the tracking of sprays and droplets. A pre-trained, ready-to-use version of DefocusTrackerAI based on YOLOv9 is available at https://gitlab.com/goncalo.coutinho/defocustrackerAI-main/-/tree/7e0f11f649ebad50e20dca5b9545f26ca303ebe0 and can be used for automatic detection of defocused particle images of any kind with high accuracy. In combination with a suitable calibration approach for the depth position, it can be used as an effective first step for three-dimensional defocusing particle tracking.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。