arXiv:2607.28538cs.CVcs.LG2026-07

用大模型生成可执行的疤痕特征程序,实现低数据依赖、本地可审计的精准分类。

ScaFE: Data-Efficient Scar Classification with LLM-Generated Clinical Feature Programs

论文配图:ScaFE: Data-Efficient Scar Classification with LLM-Generated Clinical Feature Programs
图 1 · 摘自论文原文
  • 将大模型临床知识转化为可执行特征程序,避免直接调用视觉语言模型
  • 仅需10%数据仍保持72%准确率,跨医院测试达81%平衡准确率
  • 特征程序可验证、可迭代,适合医疗数据合规要求高的场景

从临床照片中分类病理性疤痕需区分瘢痕疙瘩与增生性疤痕,但受限于专家标注数据少及医院间采集差异。端到端图像模型依赖大量数据,而使用托管的视觉-语言模型(VLM)则可能违反本地数据治理要求,且决策难以复现与审计。我们提出ScaFE(Scar Feature Engineering),将大语言模型(LLM)的临床知识转化为确定性、可执行的特征程序,而非让模型直接诊断图像。通过网络化的LLM获取临床证据并合成测量可视疤痕属性的程序,候选程序在受限制的本地环境中执行,仅返回聚合验证统计和特征级SHAP摘要用于迭代修复;原始图像与患者级输出始终保留在本地。轻量级随机森林在生成的结构化表示上运行。在三个医院共600张照片的留一院评估中,ScaFE达到81.0%的站点宏平均平衡准确率,优于最强基线BiomedCLIP 10.0个百分点。仅用10%开发数据时,仍保持72.0%平衡准确率,并领先11.8个百分点。迭代优化使可执行程序率从66.7%提升至95.0%,91.7%的最终特征获得验证证据。结果表明,通过本地可审计的特征程序,大模型知识可支持低数据依赖、跨机构的医学图像分类。

原文摘要 · Abstract (English)

Classifying pathological scars from clinical photographs requires distinguishing keloids from hypertrophic scars despite limited expert-labeled data and substantial acquisition variation across hospitals. End-to-end image models remain data-dependent, whereas sending photographs to a hosted vision-language model (VLM) may conflict with local data-governance requirements and yields decisions that are difficult to reproduce and audit. We introduce ScaFE (Scar Feature Engineering), which transfers clinical knowledge from a large language model (LLM) into deterministic, executable feature programs instead of asking the model to diagnose images. A web-enabled LLM retrieves clinical evidence and synthesizes programs that measure visually assessable scar attributes. Candidate programs execute in a restricted local environment, and only aggregate validation statistics and feature-level SHAP summaries are returned for iterative repair and refinement; raw images and patient-level outputs remain local. A lightweight Random Forest then operates on the resulting structured representation. On 600 photographs from three hospitals under leave-one-site-out evaluation, ScaFE achieves 81.0% site-macro balanced accuracy, exceeding the strongest baseline, BiomedCLIP, by 10.0 percentage points. With only 10% of the development data, ScaFE retains 72.0% balanced accuracy and an 11.8-point lead. Iterative refinement also raises the executable-program rate from 66.7% to 95.0%, with verified evidence for 91.7% of the final features. These results show that LLM knowledge can support data-efficient, cross-site medical image classification through local and auditable feature programs rather than direct VLM decisions.

疤痕分类LLM应用本地推理可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。