arXiv:2603.10833cs.CV2026-03

用少量样本快速识别药物,但复杂场景下定位能力下降。

Evaluating Few-Shot Pill Recognition Under Visual Domain Shift

  • 两阶段检测框架:先基础训练,再用1~10个样本微调。
  • 仅需1个样本即可达到分类性能饱和,但重叠遮挡时召回率大幅下降。
  • 真实多药复杂场景训练数据提升模型部署鲁棒性,适合医疗安全系统评估。

不良药物事件是可预防伤害的重要来源,促使自动化药片识别系统的发展以提升用药安全。实际部署受制于复杂的视觉条件,包括杂乱场景、重叠药片、反光及多样采集环境。本研究从部署角度出发,关注少样本药片识别在跨数据集领域偏移下的泛化能力,而非架构创新。采用两阶段目标检测框架,先进行基础训练,再对新药片类别进行少样本微调(每类1、5或10个标注样本)。在包含多目标、杂乱场景的独立部署数据集上评估模型表现,重点使用以分类为中心和基于错误的指标,以应对异构标注策略。结果表明,语义药片识别在少样本监督下可快速适应,分类性能在单样本时即达饱和;然而,在重叠与遮挡条件下,定位与召回率显著下降,尽管分类表现仍稳健。在包含真实视觉复杂性的多药数据上训练的模型,在低样本场景中展现出更强鲁棒性,凸显训练数据真实性和少样本微调对部署就绪性的诊断价值。

原文摘要 · Abstract (English)

Adverse drug events are a significant source of preventable harm, which has led to the development of automated pill recognition systems to enhance medication safety. Real-world deployment of these systems is hindered by visually complex conditions, including cluttered scenes, overlapping pills, reflections, and diverse acquisition environments. This study investigates few-shot pill recognition from a deployment-oriented perspective, prioritizing generalization under realistic cross-dataset domain shifts over architectural innovation. A two-stage object detection framework is employed, involving base training followed by few-shot fine-tuning. Models are adapted to novel pill classes using one, five, or ten labeled examples per class and are evaluated on a separate deployment dataset featuring multi-object, cluttered scenes. The evaluation focuses on classification-centric and error-based metrics to address heterogeneous annotation strategies. Findings indicate that semantic pill recognition adapts rapidly with few-shot supervision, with classification performance reaching saturation even with a single labeled example. However, stress testing under overlapping and occluded conditions demonstrates a marked decline in localization and recall, despite robust semantic classification. Models trained on visually realistic, multi-pill data consistently exhibit greater robustness in low-shot scenarios, underscoring the importance of training data realism and the diagnostic utility of few-shot fine-tuning for deployment readiness.

少样本学习药片识别视觉鲁棒性医疗安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。