arXiv:2506.00786cs.CV2025-06

用文本生成逼真病理图像,并自动筛选合格图像用于医学教学。

Aiding Medical Diagnosis through Image Synthesis and Classification

  • 用LoRA微调Stable Diffusion生成病理图像,结合提示词控制特征。
  • 分类模型准确率达99.76%,生成图像经筛选后F1得分0.6727。
  • 适合医学教育与诊断辅助,尤其对初学者有参考价值。

医疗人员,尤其是培训中的医学生,常依赖视觉参考资料以实现准确诊断并培养模式识别能力。然而现有资源在多样性与可及性方面存在不足。本文提出一个系统,可通过文本描述生成逼真医学图像,并利用分类模型验证其准确性。采用预训练的Stable Diffusion模型,基于PathMNIST数据集(包含九种结直肠组织类型)使用低秩适应(LoRA)进行微调,通过不同参数配置与领域特定提示词训练多次。为确保质量,使用相同数据集训练了ResNet-18分类模型,达到99.76%的分类准确率。生成图像经由训练好的分类器和迭代过程筛选:错误分类的图像被丢弃并重新生成,直至正确分类为止。实验中表现最佳的生成模型在分类评估中获得F1分数0.6727,精确率0.6817,召回率0.7111。部分组织类型如脂肪组织和淋巴细胞达到完美分类表现,而结构复杂的类型则更具挑战。该自验证方法在生成与分类两方面均表现出高准确性,展现出在诊断支持与临床教育中的应用潜力。未来工作将优化提示特定准确性,并扩展至其他医学影像领域。

原文摘要 · Abstract (English)

Medical professionals, especially those in training, often depend on visual reference materials to support an accurate diagnosis and develop pattern recognition skills. However, existing resources may lack the diversity and accessibility needed for broad and effective clinical learning. This paper presents a system designed to generate realistic medical images from textual descriptions and validate their accuracy through a classification model. A pretrained stable diffusion model was fine-tuned using Low-Rank Adaptation (LoRA) on the PathMNIST dataset, consisting of nine colorectal histopathology tissue types. The generative model was trained multiple times using different training parameter configurations, guided by domain-specific prompts to capture meaningful features. To ensure quality control, a ResNet-18 classification model was trained on the same dataset, achieving 99.76% accuracy in detecting the correct label of a colorectal histopathological medical image. Generated images were then filtered using the trained classifier and an iterative process, where inaccurate outputs were discarded and regenerated until they were correctly classified. The highest performing version of the generative model from experimentation achieved an F1 score of 0.6727, with precision and recall scores of 0.6817 and 0.7111, respectively. Some types of tissue, such as adipose tissue and lymphocytes, reached perfect classification scores, while others proved more challenging due to structural complexity. The self-validating approach created demonstrates a reliable method for synthesizing domain-specific medical images because of high accuracy in both the generation and classification portions of the system, with potential applications in both diagnostic support and clinical education. Future work includes improving prompt-specific accuracy and extending the system to other areas of medical imaging.

医学图像图像生成病理分析AI辅助

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。