SkinGPT-X通过自进化多智能体系统提升皮肤科诊断透明度与准确率。
SkinGPT-X: A Self-Evolving Collaborative Multi-Agent System for Transparent and Trustworthy Dermatological Diagnosis
- 构建自进化记忆的多智能体协作框架,模拟医生诊断流程。
- 在罕见病数据集上实现9.8%准确率提升,性能超越当前最优模型。
- 适合需要可解释性与高精度诊断的临床场景,尤其罕见病识别。
尽管大语言模型在皮肤科诊断中取得进展,但单体模型因训练数据稀疏,在细粒度、大规模多分类及罕见病诊断上表现不佳,且缺乏可解释性与可追溯性。现有多智能体系统多聚焦于视觉问答与对话任务,依赖静态知识库,难以适应复杂临床环境。本文提出SkinGPT-X,一个集成自进化皮肤科记忆机制的多模态协同多智能体系统,通过模拟皮肤科医生诊断流程并支持持续记忆演化,实现复杂与罕见皮肤病的透明可信诊断。我们设计三层次验证实验:首先在四个公开数据集上对比四种先进大模型,结果显示在DDI31上准确率提升9.6%,在Dermnet上加权F1提升13%;其次构建覆盖498类皮肤疾病的大型多分类数据集,评估细粒度分类能力;最后创建首个罕见皮肤病基准数据集,包含564例样本和8种罕见病。在该数据集上,SkinGPT-X实现9.8%准确率提升,加权F1提升7.1%,Cohen's Kappa提升10%。
原文摘要 · Abstract (English)
While recent advancements in Large Language Models have significantly advanced dermatological diagnosis, monolithic LLMs frequently struggle with fine-grained, large-scale multi-class diagnostic tasks and rare skin disease diagnosis owing to training data sparsity, while also lacking the interpretability and traceability essential for clinical reasoning. Although multi-agent systems can offer more transparent and explainable diagnostics, existing frameworks are primarily concentrated on Visual Question Answering and conversational tasks, and their heavy reliance on static knowledge bases restricts adaptability in complex real-world clinical settings. Here, we present SkinGPT-X, a multimodal collaborative multi-agent system for dermatological diagnosis integrated with a self-evolving dermatological memory mechanism. By simulating the diagnostic workflow of dermatologists and enabling continuous memory evolution, SkinGPT-X delivers transparent and trustworthy diagnostics for the management of complex and rare dermatological cases. To validate the robustness of SkinGPT-X, we design a three-tier comparative experiment. First, we benchmark SkinGPT-X against four state-of-the-art LLMs across four public datasets, demonstrating its state-of-the-art performance with a +9.6% accuracy improvement on DDI31 and +13% weighted F1 gain on Dermnet over the state-of-the-art model. Second, we construct a large-scale multi-class dataset covering 498 distinct dermatological categories to evaluate its fine-grained classification capabilities. Finally, we curate the rare skin disease dataset, the first benchmark to address the scarcity of clinical rare skin diseases which contains 564 clinical samples with eight rare dermatological diseases. On this dataset, SkinGPT-X achieves a +9.8% accuracy improvement, a +7.1% weighted F1 improvement, a +10% Cohen's Kappa improvement.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。