arXiv:2607.18819cs.CV2026-07

小模型通过检索实现无需训练的伤口分类,适应性强且保护隐私。

In-Context Learning for Wound Classification with Small Multimodal Language Models

论文配图:In-Context Learning for Wound Classification with Small Multimodal Language Models
图 1 · 摘自论文原文
  • 用检索增强的上下文学习让小模型直接分类伤口图像,免去重新训练。
  • 在两个数据集上最高准确率达87.2%(Kaggle)和67.8%(Medetec)。
  • 仅需8-10个示例即可达到性能饱和,适合资源受限场景。

伤口图像分类通常依赖大量人工标注数据和特定任务重训练。本研究评估小型多模态语言模型(SMLMs)通过基于检索的上下文学习(ICL)实现无需训练的伤口分类可行性。实验使用Kaggle伤口数据集(1469张图像,10类)和Medetec数据集(560张图像,9类)。测试了来自Qwen 3.5、Ministral 3和Gemma 4系列的11个SMLM,在零样本提示、随机少样本提示、基于嵌入的kNN检索及kNN+最大边际相关性重排序(MMR)条件下表现。结果显示,查询条件下的ICL优于零样本和随机少样本。在Kaggle数据集上,Qwen 3.5 27B结合kNN+MMR达0.872准确率与0.871 F1;在Medetec上为0.678准确率与0.670 F1。大模型性能超越匹配的加权kNN控制组,表明超出最近邻投票的利用。支持集缩减后性能略有下降,但8-10个示例已基本饱和。该方法使SMLMs无需任务重训即可灵活分类,紧凑检索上下文利于实际与隐私保护部署,但性能仍依赖模型规模、检索策略与数据难度。

原文摘要 · Abstract (English)

Wound image classification is often treated as a task-specific supervised learning problem, requiring substantial amounts of manually labelled data and retraining when the label space or deployment setting changes. This study evaluated whether small multimodal language models (SMLMs) can provide a training-free alternative for wound classification through retrieval-based in-context learning (ICL). Experiments used two public wound-image datasets: the Kaggle wound dataset (1469 images, 10 classes) and the Medetec dataset (560 images, 9 classes). Eleven SMLMs from the Qwen 3.5, Ministral 3, and Gemma 4 families were evaluated under zero-shot prompting and few-shot prompting with random support examples, embedding-based k-nearest-neighbour (kNN) retrieval, and kNN retrieval followed by maximal marginal relevance reranking (MMR). Retrieval-only weighted-kNN controls, support-set reduction experiments, and support-context size sweeps were used to assess the effects of retrieval, model scale, and prompt length. Query-conditioned ICL consistently outperformed zero-shot and random few-shot prompting. On the Kaggle dataset, the best result was achieved by Qwen 3.5 27B with kNN+MMR, reaching 0.872 accuracy and 0.871 F1 score. On Medetec, Qwen 3.5 27B with kNN+MMR reached 0.678 accuracy and 0.670 F1. Larger models exceeded matched weighted-kNN controls, indicating use of retrieved examples beyond nearest-neighbour voting. Retrieval-based ICL degraded modestly under support-set reduction, and most gains saturated with 8-10 support images. Retrieval-based ICL allows SMLMs to perform adaptable wound image classification without task-specific retraining. Compact retrieved contexts may support practical and privacy-conscious deployment, although performance remains dependent on model scale, retrieval strategy, and dataset difficulty.

多模态小模型零样本医学图像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。