融合异构深度学习与大模型,实现皮肤病变自动诊断与临床级报告生成。
Ensemble Deep Learning and LLM-Assisted Reporting for Automated Skin Lesion Diagnosis
- 采用多种架构的卷积神经网络集成,提升诊断多样性并自动标记不确定病例。
- 通过嵌入大语言模型生成结构化报告,涵盖病灶特征、推理过程和随访建议。
- 适合临床部署,兼顾诊断准确率与医患沟通,推动AI在皮肤科落地应用。
皮肤恶性肿瘤需早期检测以获良好预后,但当前诊断存在观察者间差异及可及性不均问题。现有AI系统受限于同质化架构、肤色数据偏差以及将自然语言处理作为独立解释模块。本文提出统一框架,通过两项协同创新重构AI在皮肤病学中的整合方式:首先,构建具有不同架构的异构卷积神经网络集成,提供互补诊断视角,并内建不确定性机制识别分歧案例,供专家复核——模拟临床最佳实践;其次,将大语言模型能力直接嵌入诊断流程,将分类结果转化为具临床意义的评估,同时满足医疗文书要求并提供患者导向教育。该无缝集成生成结构化报告,包含精准病灶描述、可理解的诊断推理及可操作的监测指导,帮助患者在就诊间隙识别早期警示信号。本框架通过单一协同系统解决诊断可靠性与沟通障碍,弥合了此前AI临床转化的关键鸿沟,显著推进可部署皮肤病学AI的发展,提升诊断精度并支持从初诊到患者教育的全程照护,最终提高皮肤病变早期干预率。
原文摘要 · Abstract (English)
Cutaneous malignancies demand early detection for favorable outcomes, yet current diagnostics suffer from inter-observer variability and access disparities. While AI shows promise, existing dermatological systems are limited by homogeneous architectures, dataset biases across skin tones, and fragmented approaches that treat natural language processing as separate post-hoc explanations rather than integral to clinical decision-making. We introduce a unified framework that fundamentally reimagines AI integration for dermatological diagnostics through two synergistic innovations. First, a purposefully heterogeneous ensemble of architecturally diverse convolutional neural networks provides complementary diagnostic perspectives, with an intrinsic uncertainty mechanism flagging discordant cases for specialist review -- mimicking clinical best practices. Second, we embed large language model capabilities directly into the diagnostic workflow, transforming classification outputs into clinically meaningful assessments that simultaneously fulfill medical documentation requirements and deliver patient-centered education. This seamless integration generates structured reports featuring precise lesion characterization, accessible diagnostic reasoning, and actionable monitoring guidance -- empowering patients to recognize early warning signs between visits. By addressing both diagnostic reliability and communication barriers within a single cohesive system, our approach bridges the critical translational gap that has prevented previous AI implementations from achieving clinical impact. The framework represents a significant advancement toward deployable dermatological AI that enhances diagnostic precision while actively supporting the continuum of care from initial detection through patient education, ultimately improving early intervention rates for skin lesions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。