arXiv:2503.21836cs.CV2025-03被引 1

iMedImage可自动分析染色体图像,准确识别结构异常。

iMedImage Technical Report

  • 统一建模多模态医学影像,支持从病例到像素的多层级识别。
  • 在12家医院数据上实现92.75%敏感度、91.5%特异度。
  • 适合临床医生用于染色体异常筛查,提升诊断效率。

染色体核型分析对遗传病诊断至关重要,但结构异常检测仍具挑战。尽管人工智能在医学影像中展现潜力,其效果在不同模态间差异显著。基于能够整合多模态医学影像以实现鲁棒特征提取与精准诊断的基座模型进展,我们开发了iMedImage——一个面向通用医学图像识别的端到端模型,在染色体异常检测等多任务中表现优异。研究构建了一个涵盖染色体、细胞、病理、超声、X光、CT和MRI等多种模态的综合医学影像数据集。基于该数据集,iMedImage具备两大核心特性:(1) 统一处理多样化模态输入与医学影像任务的表示方法;(2) 借助思维链(CoT)嵌入与专家混合(MoE)策略,实现病例级、图像级、块级的多层级识别能力。测试集包含中国六个地区12家机构的数据,覆盖三种主流扫描设备,包含自然分布且未经筛选的异常病例。在该多样化数据集上,模型实现了全自动染色体分析流程,包括分割、核型构建与异常检测,达到92.75%的敏感度与91.5%的特异度。结论表明,iMedImage是一种端到端的医学图像分析基座模型,在多种医学影像任务中表现出优越性能,为临床提供高精度影像分析工具,助力提升诊断准确率与疾病筛查水平。

原文摘要 · Abstract (English)

Background: Chromosome karyotype analysis is crucial for diagnosing hereditary diseases, yet detecting structural abnormalities remains challenging. While AI has shown promise in medical imaging, its effectiveness varies across modalities. Leveraging advances in Foundation Models that integrate multimodal medical imaging for robust feature extraction and accurate diagnosis, we developed iMedImage, an end-to-end model for general medical image recognition, demonstrating strong performance across multiple imaging tasks, including chromosome abnormality detection. Materials and Methods: We constructed a comprehensive medical image dataset encompassing multiple modalities from common medical domains, including chromosome, cell, pathology, ultrasound, X-ray, CT, and MRI images. Based on this dataset, we developed the iMedImage model, which incorporates the following key features: (1) a unified representation method for diverse modality inputs and medical imaging tasks; (2) multi-level (case-level, image-level, patch-level) image recognition capabilities enhanced by Chain of Thought (CoT) embedding and Mixture of Experts (MoE) strategies. Results: The test set comprised data from 12 institutions across six regions in China, covering three mainstream scanning devices, and included naturally distributed, unscreened abnormal cases. On this diverse dataset, the model achieved a fully automated chromosome analysis workflow, including segmentation, karyotyping, and abnormality detection, reaching a sensitivity of 92.75% and a specificity of 91.5%. Conclusion: We propose iMedImage, an end-to-end foundation model for medical image analysis, demonstrating its superior performance across various medical imaging tasks. iMedImage provides clinicians with a precise imaging analysis tool and contributes to improving diagnostic accuracy and disease screening.

医学影像染色体分析多模态基座模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。