用轻量多智能体框架实现中医皮肤病诊疗,适配真实临床场景。
DERM-3R: A Resource-Efficient Multimodal Agents Framework for Dermatologic Diagnosis and Treatment in Real-World Clinical Settings
- 分三步构建:病变识别、多视角建模、整体辨证治疗
- 仅用103例数据训练,性能媲美大型模型
- 适合资源有限的临床系统,尤其中医与皮肤科融合应用
皮肤病在全球范围内造成巨大负担,影响数十亿人并显著降低生活质量。尽管现代疗法可快速控制急性症状,但长期疗效受限于单一靶点、反复发作及对全身共病关注不足。传统中医通过辨证论治提供整体化治疗,但实践受限于知识不标准化、多模态记录不完整以及专家推理难以扩展。本文提出 DERM-3R,一个面向真实临床环境的资源高效多模态智能体框架,用于建模中医皮肤病诊断与治疗。基于真实工作流,将决策重构为三个核心问题:细粒度病变识别、具备专科级病理机制建模的多视角病变表征,以及辨证与治疗规划的全局推理。DERM-3R 包含三个协同智能体:DERM-Rec(识别)、DERM-Rep(表征)、DERM-Reason(推理),均基于轻量多模态大模型,并在103例真实世界中医银屑病病例上部分微调。评估显示,尽管数据和参数更新极少,其在皮肤病推理任务中表现优于或匹配大型通用多模态模型。结果表明,结构化、领域感知的多智能体建模可作为复杂临床任务中粗暴扩展的可行替代方案,适用于皮肤科与整合医学。
原文摘要 · Abstract (English)
Dermatologic diseases impose a large and growing global burden, affecting billions and substantially reducing quality of life. While modern therapies can rapidly control acute symptoms, long-term outcomes are often limited by single-target paradigms, recurrent courses, and insufficient attention to systemic comorbidities. Traditional Chinese medicine (TCM) provides a complementary holistic approach via syndrome differentiation and individualized treatment, but practice is hindered by non-standardized knowledge, incomplete multimodal records, and poor scalability of expert reasoning. We propose DERM-3R, a resource-efficient multimodal agent framework to model TCM dermatologic diagnosis and treatment under limited data and compute. Based on real-world workflows, we reformulate decision-making into three core issues: fine-grained lesion recognition, multi-view lesion representation with specialist-level pathogenesis modeling, and holistic reasoning for syndrome differentiation and treatment planning. DERM-3R comprises three collaborative agents: DERM-Rec, DERM-Rep, and DERM-Reason, each targeting one component of this pipeline. Built on a lightweight multimodal LLM and partially fine-tuned on 103 real-world TCM psoriasis cases, DERM-3R performs strongly across dermatologic reasoning tasks. Evaluations using automatic metrics, LLM-as-a-judge, and physician assessment show that despite minimal data and parameter updates, DERM-3R matches or surpasses large general-purpose multimodal models. These results suggest structured, domain-aware multi-agent modeling can be a practical alternative to brute-force scaling for complex clinical tasks in dermatology and integrative medicine.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。