arXiv:2512.08998eess.IVcs.AI2025-12

专为皮肤科设计的AI助手,自动优化模型并生成医生级诊断解释。

DermETAS-SNA LLM: A Dermatology Focused Evolutionary Transformer Architecture Search with StackNet Augmented LLM Assistant

  • 用进化算法优化视觉变压器,针对皮肤病特征定制模型。
  • 多分类器堆叠提升准确率,F1得分达56.30%,比SkinGPT-4高16.06%。
  • 结合大模型生成患者可懂的诊断说明,临床专家认可率达92%。

本文提出DermETAS-SNA LLM助手,融合皮肤科专用的进化式Transformer架构搜索与堆叠网络增强的大语言模型。该助手动态学习皮肤疾病分类器,并生成医学严谨的解释以辅助医患沟通。主要贡献包括:(1) 在SKINCON数据集上构建ETAS框架,优化视觉变压器(ViT)以强化皮肤病特征表达,并在DermNet数据集的23类皮肤病上微调二分类器,提升分类性能;(2) 设计堆叠网络(StackNet)集成多个微调后的二分类ViT,增强预测鲁棒性并缓解类别不平衡问题;(3) 实现基于RAG的诊断解释与检索模型,利用Google Gemini 2.5 Pro LLM生成个性化、上下文相关的患者诊断描述,依托权威皮肤病资料库;(4) 在23类皮肤病上进行大量实验,总体F1分数达56.30%,较SkinGPT-4的48.51%提升16.06%;(5) 邀请八位持证医师对七种皮肤病的AI生成响应进行评估,结果与人工判断一致率达92%;(6) 构建原型系统,完整集成DermETAS-SNA LLM,验证其在真实临床与教育场景中的可行性。

原文摘要 · Abstract (English)

Our work introduces the DermETAS-SNA LLM Assistant that integrates Dermatology-focused Evolutionary Transformer Architecture Search with StackNet Augmented LLM. The assistant dynamically learns skin-disease classifiers and provides medically informed descriptions to facilitate clinician-patient interpretation. Contributions include: (1) Developed an ETAS framework on the SKINCON dataset to optimize a Vision Transformer (ViT) tailored for dermatological feature representation and then fine-tuned binary classifiers for each of the 23 skin disease categories in the DermNet dataset to enhance classification performance; (2) Designed a StackNet architecture that integrates multiple fine-tuned binary ViT classifiers to enhance predictive robustness and mitigate class imbalance issues; (3) Implemented a RAG pipeline, termed Diagnostic Explanation and Retrieval Model for Dermatology, which harnesses the capabilities of the Google Gemini 2.5 Pro LLM architecture to generate personalized, contextually informed diagnostic descriptions and explanations for patients, leveraging a repository of verified dermatological materials; (4) Performed extensive experimental evaluations on 23 skin disease categories to demonstrate performance increase, achieving an overall F1-score of 56.30% that surpasses SkinGPT-4 (48.51%) by a considerable margin, representing a performance increase of 16.06%; (5) Conducted a domain-expert evaluation, with eight licensed medical doctors, of the clinical responses generated by our AI assistant for seven dermatological conditions. Our results show a 92% agreement rate with the assessments provided by our AI assistant (6) Created a proof-of-concept prototype that fully integrates our DermETAS-SNA LLM into our AI assistant to demonstrate its practical feasibility for real-world clinical and educational applications.

皮肤科AI视觉变压器大模型应用医疗解释

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。