arXiv:2508.06021cs.CVcs.AI2025-08被引 2

用生成模型合成微小颗粒图像,解决数据不足与类别不平衡问题。

Improved Sub-Visible Particle Classification in Flow Imaging Microscopy via Generative AI-Based Image Synthesis

  • 构建扩散模型生成高保真颗粒图像以补充训练数据。
  • 在50万张蛋白颗粒图像上验证,分类性能显著提升。
  • 开源模型与接口,便于工业界和学术界复现使用。

基于流式成像显微镜与深度学习的亚可见颗粒分析已证明能有效区分硅油等无害成分与蛋白颗粒。然而,数据稀缺及各类别样本严重失衡仍是多类分类器应用的主要障碍,尤其对硅油、气泡等意外出现且数量少的颗粒类型更为严峻。本文开发了一种先进的扩散模型,通过生成高保真图像来缓解数据不平衡问题,从而支持多类深度神经网络的有效训练。实验表明,生成图像在视觉质量和结构上与真实图像高度相似。我们在包含50万张蛋白颗粒图像的验证数据集上开展大规模测试,证实该方法可显著提升分类性能且无明显副作用。为促进开放研究与可复现性,我们已将扩散模型、训练好的多类分类器及简易集成接口公开发布于https://github.com/utkuozbulak/svp-generative-ai。

原文摘要 · Abstract (English)

Sub-visible particle analysis using flow imaging microscopy combined with deep learning has proven effective in identifying particle types, enabling the distinction of harmless components such as silicone oil from protein particles. However, the scarcity of available data and severe imbalance between particle types within datasets remain substantial hurdles when applying multi-class classifiers to such problems, often forcing researchers to rely on less effective methods. The aforementioned issue is particularly challenging for particle types that appear unintentionally and in lower numbers, such as silicone oil and air bubbles, as opposed to protein particles, where obtaining large numbers of images through controlled settings is comparatively straightforward. In this work, we develop a state-of-the-art diffusion model to address data imbalance by generating high-fidelity images that can augment training datasets, enabling the effective training of multi-class deep neural networks. We validate this approach by demonstrating that the generated samples closely resemble real particle images in terms of visual quality and structure. To assess the effectiveness of using diffusion-generated images in training datasets, we conduct large-scale experiments on a validation dataset comprising 500,000 protein particle images and demonstrate that this approach improves classification performance with no negligible downside. Finally, to promote open research and reproducibility, we publicly release both our diffusion models and the trained multi-class deep neural network classifiers, along with a straightforward interface for easy integration into future studies, at https://github.com/utkuozbulak/svp-generative-ai.

生成模型颗粒检测数据增强扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。