用扩散模型让合成显微图像更像真实图像,提升细胞计数准确率。
Reducing Domain Gap with Diffusion-Based Domain Adaptation for Cell Counting
- 用扩散模型+风格迁移,把合成图像变得像真实显微图像。
- 细胞计数误差比传统合成数据低37%,比公开数据集低52%。
- 适合需要少标注、高精度细胞计数的研究者使用。
在标签稀缺的细胞计数场景中,生成逼真的合成显微图像对训练深度学习模型至关重要。然而,传统领域自适应方法在合成图像缺乏真实样本复杂纹理时效果不佳。本文将原本用于艺术风格迁移的基于反演的风格迁移(InST)框架应用于生物医学显微图像,结合潜在空间自适应实例归一化与扩散模型中的随机反演,将真实荧光显微图像的风格迁移到合成图像上,同时弱保留内容结构。我们在多种数据源(真实数据、硬编码合成数据、公开的Cell200-s数据集)上预训练并微调EfficientNet-B0模型,评估所提InST合成数据的有效性。使用InST合成图像训练的模型相比硬编码合成数据训练的模型,平均绝对误差(MAE)降低37%,相比Cell200-s数据集训练的模型降低52%(从53.70降至25.95)。尤为显著的是,其表现优于仅使用真实数据训练的模型(25.95 vs. 27.74 MAE)。进一步结合轻量级领域自适应技术如DACS与CutMix,性能持续提升。结果表明,InST风格迁移能最有效缩小合成与真实显微数据之间的域差距。该方法为减少人工标注的同时提升细胞计数性能提供了可扩展路径。代码与资源已公开于:https://github.com/MohammadDehghan/InST-Microscopy。
原文摘要 · Abstract (English)
Generating realistic synthetic microscopy images is critical for training deep learning models in label-scarce environments, such as cell counting with many cells per image. However, traditional domain adaptation methods often struggle to bridge the domain gap when synthetic images lack the complex textures and visual patterns of real samples. In this work, we adapt the Inversion-Based Style Transfer (InST) framework originally designed for artistic style transfer to biomedical microscopy images. Our method combines latent-space Adaptive Instance Normalization with stochastic inversion in a diffusion model to transfer the style from real fluorescence microscopy images to synthetic ones, while weakly preserving content structure. We evaluate the effectiveness of our InST-based synthetic dataset for downstream cell counting by pre-training and fine-tuning EfficientNet-B0 models on various data sources, including real data, hard-coded synthetic data, and the public Cell200-s dataset. Models trained with our InST-synthesized images achieve up to 37\% lower Mean Absolute Error (MAE) compared to models trained on hard-coded synthetic data, and a 52\% reduction in MAE compared to models trained on Cell200-s (from 53.70 to 25.95 MAE). Notably, our approach also outperforms models trained on real data alone (25.95 vs. 27.74 MAE). Further improvements are achieved when combining InST-synthesized data with lightweight domain adaptation techniques such as DACS with CutMix. These findings demonstrate that InST-based style transfer most effectively reduces the domain gap between synthetic and real microscopy data. Our approach offers a scalable path for enhancing cell counting performance while minimizing manual labeling effort. The source code and resources are publicly available at: https://github.com/MohammadDehghan/InST-Microscopy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。