arXiv:2608.03225cs.CV2026-08中稿 · ACM Multimedia 202…

统一跨机构皮肤图像诊断概念,让医生能灵活干预模型决策。

Open-Linguistic Concept Unified Learning for Cross-Site Interpretable Dermatology Image Diagnosis

论文配图:Open-Linguistic Concept Unified Learning for Cross-Site Interpretable Dermatology Image Diagnosis
图 1 · 摘自论文原文
  • 用共享语义空间整合不同模态的医学概念体系。
  • 通过开放语言描述提升模型对模糊病灶的敏感度。
  • 支持跨机构可调的医生介入接口,实现稳定可迁移的解释性诊断。

可解释的计算机辅助诊断对临床决策至关重要。基于概念的模型通过透明推理和事后医生干预实现可解释性,但其依赖特定数据集的刚性适配限制了跨机构泛化能力。在不同模态(如皮肤镜与临床照片)间应用时,由于概念分类体系在可用性、粒度和语义上差异显著,导致适应基础视觉-语言模型需大量标注工程与重复微调。现有干预机制也局限于预定义概念,缺乏灵活性,阻碍可扩展的皮肤病学辅助诊断部署。为此,我们提出UniCon:一种面向多模态可解释视觉-语言诊断的开放式统一概念学习框架。通过三项创新:(1) 通过统一概念原型码本构建共享语义表示空间,无需数据集特异性训练即可协调异构概念系统;(2) 基于开放语言的多维语义描述,克服文本标签稀疏问题,增强不确定临床场景下的边界敏感性;(3) 由可靠性门控瓶颈聚合驱动的鲁棒可调干预接口,实现一致推理与可迁移的医生修正。大量实验表明,UniCon不仅达到顶级诊断准确率,更成功弥合不同临床分类体系,解锁前所未有的跨机构干预能力。代码已开源:https://github.com/wuchengyu123/UniCon。

原文摘要 · Abstract (English)

Human-interpretable computer-aided diagnosis is crucial for clinical decision making. Concept-based models excel by providing transparent reasoning and enabling post-hoc, clinician-in-the-loop interventions. However, their rigid dataset-specific adaptation inherently restricts cross-site generalization. Applying them across diverse modalities, such as dermoscopic and clinical photographs, is challenging due to heterogeneous concept taxonomies varying in availability, granularity, and semantics across cohorts. Consequently, adapting Foundation Vision-Language Models (FVLMs) demands costly label engineering and repeated post-training. Existing intervention mechanisms remain rigidly tied to predefined concepts, lacking adaptability and hindering scalable dermatology CAD deployment. To address these bottlenecks, we propose UniCon, an open-linguistic unified concept learning framework for multimodal interpretable vision-language diagnosis. UniCon resolves these challenges through three contributions: (1) A shared semantic representation space via a unified concept prototype codebook, seamlessly coordinating heterogeneous concept systems across modalities without dataset-specific retraining. (2) Open-linguistic based multi-faceted semantic specifications to overcome sparse textual label limitations, improving boundary sensitivity in uncertain clinical contexts. (3) A robust, cross-site adjustable intervention interface powered by reliability-gated bottleneck aggregation, enabling consistent reasoning and transferable clinician corrections. Extensive experiments demonstrate that beyond securing top-tier diagnostic accuracy, UniCon successfully bridges disparate clinical taxonomies, unlocking unprecedented cross-site intervention capabilities. Code is available at https://github.com/wuchengyu123/UniCon.

可解释诊断多模态皮肤图像概念学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。