arXiv:2411.00916cs.CVcs.AI2024-11被引 6

融合临床与影像数据,提升骨质疏松诊断准确率与可解释性。

Enhancing Osteoporosis Detection: An Explainable Multi-Modal Learning Framework with Feature Fusion and Variable Clustering

  • 用VGG19、InceptionV3、ResNet50提取X光片深层特征,结合PCA降维。
  • 临床数据中病史、BMI和身高贡献最大,影像特征重要性较低。
  • 通过特征重要性图实现可解释预测,适合临床医生信任AI辅助诊断。

骨质疏松症是一种常见疾病,显著增加老年人骨折风险。早期诊断对预防骨折、降低治疗成本和维持行动能力至关重要。然而,医疗人员面临标注数据有限和医学图像处理困难等挑战。本研究提出一种新型多模态学习框架,整合临床与影像数据以提升诊断准确性和模型可解释性。模型采用VGG19、InceptionV3和ResNet50三个预训练网络从X光片中提取深度特征,并通过PCA降维聚焦关键成分。基于聚类的筛选方法选出最具代表性的特征组件,再与预处理后的临床数据一同输入全连接网络(FCN)进行最终分类。特征重要性图显示,病史、体重指数(BMI)和身高是主要贡献变量,凸显患者个体化数据的重要性。尽管影像特征有帮助,其重要性低于临床数据,表明临床信息在精准预测中起核心作用。该框架实现高精度且可解释的预测,提升AI诊断的透明度,增强临床应用中的信任度。

原文摘要 · Abstract (English)

Osteoporosis is a common condition that increases fracture risk, especially in older adults. Early diagnosis is vital for preventing fractures, reducing treatment costs, and preserving mobility. However, healthcare providers face challenges like limited labeled data and difficulties in processing medical images. This study presents a novel multi-modal learning framework that integrates clinical and imaging data to improve diagnostic accuracy and model interpretability. The model utilizes three pre-trained networks-VGG19, InceptionV3, and ResNet50-to extract deep features from X-ray images. These features are transformed using PCA to reduce dimensionality and focus on the most relevant components. A clustering-based selection process identifies the most representative components, which are then combined with preprocessed clinical data and processed through a fully connected network (FCN) for final classification. A feature importance plot highlights key variables, showing that Medical History, BMI, and Height were the main contributors, emphasizing the significance of patient-specific data. While imaging features were valuable, they had lower importance, indicating that clinical data are crucial for accurate predictions. This framework promotes precise and interpretable predictions, enhancing transparency and building trust in AI-driven diagnoses for clinical integration.

骨质疏松多模态可解释性医疗AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。