打造通用皮肤科AI模型,提升诊断准确率与跨场景适应性
DermINO: Hybrid Pretraining for a Versatile Dermatology Foundation Model
- 采用混合预训练框架,融合自监督与半监督学习提升模型理解力
- 在20个数据集上超越现有模型,恶性肿瘤分类准确率达95.79%
- 适合临床辅助诊断、多类型皮肤病识别及隐私保护场景使用
皮肤疾病对全球医疗系统构成重大负担,其高发病率(影响高达70%人口)、复杂诊断流程以及资源匮乏地区皮肤病医生严重短缺是主要挑战。尽管人工智能在皮肤图像分析中展现潜力,但现有模型多依赖大规模人工标注数据,且任务专一,实际应用效果有限。为此,我们提出DermNIO——一个通用皮肤科基础模型。该模型在来自三个来源(公开数据库、网络采集图像、自有数据集)的432,776张图像上进行训练,采用新颖的混合预训练框架,通过半监督学习和知识引导的原型初始化增强自监督学习。该方法不仅深化了对复杂皮肤病的理解,显著提升了跨多种临床任务的泛化能力。在20个数据集上的评估显示,DermNIO持续优于现有顶尖模型,在恶性肿瘤分类、疾病严重程度分级、多类别诊断和皮肤图像描述等高级临床任务中表现优异,同时在皮肤病变分割等低级任务上也达到领先水平。此外,DermNIO在隐私保护的联邦学习场景下表现稳健,并适用于不同肤色与性别。一项包含23名皮肤科医生的盲测研究显示,DermNIO诊断准确率达95.79%(医生平均为73.66%),AI辅助使医生表现提升17.21%。
原文摘要 · Abstract (English)
Skin diseases impose a substantial burden on global healthcare systems, driven by their high prevalence (affecting up to 70% of the population), complex diagnostic processes, and a critical shortage of dermatologists in resource-limited areas. While artificial intelligence(AI) tools have demonstrated promise in dermatological image analysis, current models face limitations-they often rely on large, manually labeled datasets and are built for narrow, specific tasks, making them less effective in real-world settings. To tackle these limitations, we present DermNIO, a versatile foundation model for dermatology. Trained on a curated dataset of 432,776 images from three sources (public repositories, web-sourced images, and proprietary collections), DermNIO incorporates a novel hybrid pretraining framework that augments the self-supervised learning paradigm through semi-supervised learning and knowledge-guided prototype initialization. This integrated method not only deepens the understanding of complex dermatological conditions, but also substantially enhances the generalization capability across various clinical tasks. Evaluated across 20 datasets, DermNIO consistently outperforms state-of-the-art models across a wide range of tasks. It excels in high-level clinical applications including malignancy classification, disease severity grading, multi-category diagnosis, and dermatological image caption, while also achieving state-of-the-art performance in low-level tasks such as skin lesion segmentation. Furthermore, DermNIO demonstrates strong robustness in privacy-preserving federated learning scenarios and across diverse skin types and sexes. In a blinded reader study with 23 dermatologists, DermNIO achieved 95.79% diagnostic accuracy (versus clinicians' 73.66%), and AI assistance improved clinician performance by 17.21%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。