arXiv:2510.25199cs.CV2025-10

用图像和声音分析,实现三种重病的早期无创筛查。

AI-Powered Early Detection of Critical Diseases using Image Processing and Audio Analysis

  • 融合图像、热成像和音频信号,构建多模态诊断模型。
  • 在皮肤癌、血栓和心肺异常检测上分别达到89.3%、86.4%、87.2%准确率。
  • 模型轻量可部署,适合资源匮乏地区的快速筛查。

早期诊断重大疾病可显著提升患者生存率并降低治疗成本。然而,现有诊断手段常昂贵、侵入性强,且在低资源地区难以获取。本文提出一种融合图像分析、热成像与音频信号处理的多模态AI诊断框架,用于皮肤癌、血管血栓及心肺异常的早期检测。基于ISIC 2019数据集,微调后的MobileNetV2在皮肤病变分类中达89.3%准确率、91.6%敏感度与88.2%特异度;采用手工特征的SVM在合成与临床数据上对热成像血栓检测实现86.4%准确率(AUC=0.89);基于PhysioNet与Pascal数据集,通过MFCC提取特征并使用随机森林分类心肺音,准确率达87.2%,敏感度为85.7%。与先进模型对比显示,该系统在保持竞争力的同时具备轻量化优势,适用于低成本设备部署,为可扩展、实时、可及的AI辅助预诊断医疗方案提供可行路径。

原文摘要 · Abstract (English)

Early diagnosis of critical diseases can significantly improve patient survival and reduce treatment costs. However, existing diagnostic techniques are often costly, invasive, and inaccessible in low-resource regions. This paper presents a multimodal artificial intelligence (AI) diagnostic framework integrating image analysis, thermal imaging, and audio signal processing for early detection of three major health conditions: skin cancer, vascular blood clots, and cardiopulmonary abnormalities. A fine-tuned MobileNetV2 convolutional neural network was trained on the ISIC 2019 dataset for skin lesion classification, achieving 89.3% accuracy, 91.6% sensitivity, and 88.2% specificity. A support vector machine (SVM) with handcrafted features was employed for thermal clot detection, achieving 86.4% accuracy (AUC = 0.89) on synthetic and clinical data. For cardiopulmonary analysis, lung and heart sound datasets from PhysioNet and Pascal were processed using Mel-Frequency Cepstral Coefficients (MFCC) and classified via Random Forest, reaching 87.2% accuracy and 85.7% sensitivity. Comparative evaluation against state-of-the-art models demonstrates that the proposed system achieves competitive results while remaining lightweight and deployable on low-cost devices. The framework provides a promising step toward scalable, real-time, and accessible AI-based pre-diagnostic healthcare solutions.

AI医疗多模态早期诊断轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。