arXiv:2506.04673cs.CV2025-06被引 3

让少样本图像分类更准确且可解释,通过专家混合的轻量适配方法。

Interpretable Few-Shot Image Classification via Prototypical Concept-Guided Mixture of LoRA Experts

  • 用多专家低秩适配器平衡主干与概念学习模块的参数分配。
  • 在6个数据集上5类5样本任务中提升4.2%至8.7%准确率。
  • 通过几何约束减少概念重叠,让模型决策更透明可读。

自解释模型依赖原型概念学习提升可解释性,但在数据稀缺场景下表现不佳。为此,本文提出少样本原型概念分类(FSPCC)框架,系统解决低数据下的参数失衡与表征错位问题。采用基于LoRA的专家混合(MoLE)实现高效参数配置,确保主干网络与概念学习模块间参数均衡;引入跨模块概念引导机制,对齐特征表示与原型激活模式;设计多层级特征保留策略,融合不同层的空间与语义信息以增强表征能力。进一步提出几何感知的概念判别损失,强制概念间正交,提升解耦性与透明度。在CUB-200-2011、mini-ImageNet、CIFAR-FS、Stanford Cars、FGVC-Aircraft和DTD六个基准上验证,5类5样本设置下相较现有自解释模型显著提升4.2%–8.7%相对性能,证明概念学习与少样本适应结合能兼顾高精度与强可解释性。

原文摘要 · Abstract (English)

Self-Explainable Models (SEMs) rely on Prototypical Concept Learning (PCL) to enable their visual recognition processes more interpretable, but they often struggle in data-scarce settings where insufficient training samples lead to suboptimal performance.To address this limitation, we propose a Few-Shot Prototypical Concept Classification (FSPCC) framework that systematically mitigates two key challenges under low-data regimes: parametric imbalance and representation misalignment. Specifically, our approach leverages a Mixture of LoRA Experts (MoLE) for parameter-efficient adaptation, ensuring a balanced allocation of trainable parameters between the backbone and the PCL module.Meanwhile, cross-module concept guidance enforces tight alignment between the backbone's feature representations and the prototypical concept activation patterns.In addition, we incorporate a multi-level feature preservation strategy that fuses spatial and semantic cues across various layers, thereby enriching the learned representations and mitigating the challenges posed by limited data availability.Finally, to enhance interpretability and minimize concept overlap, we introduce a geometry-aware concept discrimination loss that enforces orthogonality among concepts, encouraging more disentangled and transparent decision boundaries.Experimental results on six popular benchmarks (CUB-200-2011, mini-ImageNet, CIFAR-FS, Stanford Cars, FGVC-Aircraft, and DTD) demonstrate that our approach consistently outperforms existing SEMs by a notable margin, with 4.2%-8.7% relative gains in 5-way 5-shot classification.These findings highlight the efficacy of coupling concept learning with few-shot adaptation to achieve both higher accuracy and clearer model interpretability, paving the way for more transparent visual recognition systems.

少样本学习可解释性LoRA概念学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。