arXiv:2606.18063cs.CVcs.AI2026-06

用大模型生成可解释的疤痕特征代码,解决标注数据少的临床难题。

When LLMs Analyze Scars: From Images to Clinically-Meaningful Features

论文配图:When LLMs Analyze Scars: From Images to Clinically-Meaningful Features
图 1 · 摘自论文原文
  • 让大模型根据临床标准生成可执行的特征提取代码
  • 仅需少量数据即达优于端到端模型的分类效果
  • 适合需要可解释性与隐私保护的医疗AI场景

医学图像分类面临根本困境:深度学习虽在大规模数据上表现优异,但真实临床中因标注成本、隐私限制和疾病罕见导致数据极度稀缺。疤痕分类尤为困难,区分增生性疤痕与瘢痕疙瘩需细微专家知识,标注样本极少。本文提出新范式,将大语言模型(LLMs)作为知识驱动的特征工程工具,而非端到端分类器,命名为ScaFE(Scar Feature Engineering)。核心洞察是:LLMs蕴含丰富医学知识,可被提取为可执行的特征提取代码,将高维图像转化为低维、临床可解释的表示。具体地,我们以既定疤痕评估标准为提示,引导LLM生成符合临床评分系统(如Vancouver Scar Scale)的确定性Python代码。该方法具备三大优势:(1) 数据高效,通过解耦知识获取与统计学习,在有限样本下实现稳健性能;(2) 隐私保护,原始图像本地处理,无需暴露给外部LLM;(3) 可解释性,特征明确基于临床推理。在疤痕分类上的大量实验表明,本方法在数据受限条件下持续优于端到端深度学习基线或将LLM作为黑箱分类器,为构建数据高效且临床透明的医疗AI系统提供可行路径。

原文摘要 · Abstract (English)

Medical image classification faces a fundamental dilemma: while deep learning models achieve remarkable performance at scale, real-world clinical scenarios often suffer from severe data scarcity due to annotation costs, privacy constraints, and disease rarity. This challenge is particularly pronounced in pathological scar classification, where differentiating keloids from hypertrophic scars requires subtle expert knowledge and labeled images are extremely limited. We propose a novel paradigm that repositions large language models (LLMs) as knowledge-driven feature engineers rather than end-to-end classifiers. We call this framework ScaFE (Scar Feature Engineering). Our key insight is that LLMs encode rich medical knowledge that can be externalized as executable feature extraction code, enabling the transformation of high-dimensional images into low-dimensional, clinically interpretable representations. Specifically, we prompt an LLM with established scar assessment criteria to generate deterministic Python code that extracts features aligned with clinical scoring systems such as the Vancouver Scar Scale. Our approach offers three key advantages: (1) data efficiency, achieving robust performance with limited training samples by decoupling knowledge acquisition from statistical learning; (2) privacy preservation, as raw images are processed locally without exposure to external LLMs; and (3) interpretability, through explicit features grounded in clinical reasoning. Extensive experiments on scar classification demonstrate that our method consistently outperforms end-to-end deep learning baselines or using LLMs as black-box classifiers under limited data conditions, establishing a promising direction for integrating LLMs into data-efficient and clinically transparent medical AI systems.

医疗AI大模型应用可解释性数据高效

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。