用少量数据直接生成医学图像分类模型,无需训练。
Zero-Training Task-Specific Model Synthesis for Few-Shot Medical Image Classification
- 输入一张图像和描述,用生成模型直接合成分类器参数。
- 1样本和5样本场景下性能超越现有方法,罕见病分类效果显著。
- 适合数据稀缺的医疗场景,加速诊断工具开发。
深度学习在医学图像分析中表现卓越,但严重依赖大规模、精细标注数据。这一需求在医疗领域成为瓶颈,因患者数据难获取,专家标注成本高,尤其对罕见病而言样本本就稀少。为突破此限制,我们提出零训练任务特异性模型合成(ZS-TMS)新范式。不需微调或重新训练,该方法利用大规模预训练生成引擎,直接合成针对特定任务的分类器参数。其框架语义引导参数合成器(SGPS)仅需极少量多模态信息——如单张图像(1样本)及对应临床文本描述——即可生成轻量高效分类器(如EfficientNet-V2)的完整参数,可立即部署推理,无需任务特定训练。我们在基于ISIC 2018皮肤病变数据集和自建罕见病数据集的挑战性少样本分类基准上进行评估,结果表明SGPS达到新最佳水平,尤其在1样本与5样本超低数据条件下显著优于先进少样本与零样本学习方法。该工作为人工智能诊断工具的快速开发与部署铺平道路,尤其适用于数据极度匮乏的罕见病领域。
原文摘要 · Abstract (English)
Deep learning models have achieved remarkable success in medical image analysis but are fundamentally constrained by the requirement for large-scale, meticulously annotated datasets. This dependency on "big data" is a critical bottleneck in the medical domain, where patient data is inherently difficult to acquire and expert annotation is expensive, particularly for rare diseases where samples are scarce by definition. To overcome this fundamental challenge, we propose a novel paradigm: Zero-Training Task-Specific Model Synthesis (ZS-TMS). Instead of adapting a pre-existing model or training a new one, our approach leverages a large-scale, pre-trained generative engine to directly synthesize the entire set of parameters for a task-specific classifier. Our framework, the Semantic-Guided Parameter Synthesizer (SGPS), takes as input minimal, multi-modal task information as little as a single example image (1-shot) and a corresponding clinical text description to directly synthesize the entire set of parameters for a task-specific classifier. The generative engine interprets these inputs to generate the weights for a lightweight, efficient classifier (e.g., an EfficientNet-V2), which can be deployed for inference immediately without any task-specific training or fine-tuning. We conduct extensive evaluations on challenging few-shot classification benchmarks derived from the ISIC 2018 skin lesion dataset and a custom rare disease dataset. Our results demonstrate that SGPS establishes a new state-of-the-art, significantly outperforming advanced few-shot and zero-shot learning methods, especially in the ultra-low data regimes of 1-shot and 5-shot classification. This work paves the way for the rapid development and deployment of AI-powered diagnostic tools, particularly for the long tail of rare diseases where data is critically limited.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。