用大模型生成可执行的疤痕特征程序,实现低数据依赖、本地可审计的精准分类。
ScaFE: Data-Efficient Scar Classification with LLM-Generated Clinical Feature Programs

- 将大模型临床知识转化为可执行特征程序,避免直接调用视觉语言模型
- 仅需10%数据仍保持72%准确率,跨医院测试达81%平衡准确率
- 特征程序可验证、可迭代,适合医疗数据合规要求高的场景
从临床照片中分类病理性疤痕需区分瘢痕疙瘩与增生性疤痕,但受限于专家标注数据少及医院间采集差异。端到端图像模型依赖大量数据,而使用托管的视觉-语言模型(VLM)则可能违反本地数据治理要求,且决策难以复现与审计。我们提出ScaFE(Scar Feature Engineering),将大语言模型(LLM)的临床知识转化为确定性、可执行的特征程序,而非让模型直接诊断图像。通过网络化的LLM获取临床证据并合成测量可视疤痕属性的程序,候选程序在受限制的本地环境中执行,仅返回聚合验证统计和特征级SHAP摘要用于迭代修复;原始图像与患者级输出始终保留在本地。轻量级随机森林在生成的结构化表示上运行。在三个医院共600张照片的留一院评估中,ScaFE达到81.0%的站点宏平均平衡准确率,优于最强基线BiomedCLIP 10.0个百分点。仅用10%开发数据时,仍保持72.0%平衡准确率,并领先11.8个百分点。迭代优化使可执行程序率从66.7%提升至95.0%,91.7%的最终特征获得验证证据。结果表明,通过本地可审计的特征程序,大模型知识可支持低数据依赖、跨机构的医学图像分类。
原文摘要 · Abstract (English)
Classifying pathological scars from clinical photographs requires distinguishing keloids from hypertrophic scars despite limited expert-labeled data and substantial acquisition variation across hospitals. End-to-end image models remain data-dependent, whereas sending photographs to a hosted vision-language model (VLM) may conflict with local data-governance requirements and yields decisions that are difficult to reproduce and audit. We introduce ScaFE (Scar Feature Engineering), which transfers clinical knowledge from a large language model (LLM) into deterministic, executable feature programs instead of asking the model to diagnose images. A web-enabled LLM retrieves clinical evidence and synthesizes programs that measure visually assessable scar attributes. Candidate programs execute in a restricted local environment, and only aggregate validation statistics and feature-level SHAP summaries are returned for iterative repair and refinement; raw images and patient-level outputs remain local. A lightweight Random Forest then operates on the resulting structured representation. On 600 photographs from three hospitals under leave-one-site-out evaluation, ScaFE achieves 81.0% site-macro balanced accuracy, exceeding the strongest baseline, BiomedCLIP, by 10.0 percentage points. With only 10% of the development data, ScaFE retains 72.0% balanced accuracy and an 11.8-point lead. Iterative refinement also raises the executable-program rate from 66.7% to 95.0%, with verified evidence for 91.7% of the final features. These results show that LLM knowledge can support data-efficient, cross-site medical image classification through local and auditable feature programs rather than direct VLM decisions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。