arXiv:2508.12745cs.CVcs.AI2025-08

提出新模型提升图像集分类精度,尤其在小样本场景下表现优异。

DCSCR: A Class-Specific Collaborative Representation based Network for Image Set Classification

  • 分层级学习图像集的局部与全局特征
  • 通过自适应机制计算不同图像集间距离相似性
  • 适合小样本图像集分类任务,性能优于现有方法

图像集分类(ISC)旨在比较由数量和质量不一的无序图像组成的集合间的相似性,近年来受到广泛关注。如何有效学习特征表示并挖掘不同图像集间的相似性是该领域的两大挑战。传统方法依赖原始像素特征,忽视特征学习;现有深度方法虽能提取深层特征,却无法在度量集合距离时自适应调整特征,导致小样本场景下性能受限。为此,本文结合传统方法与深度模型,提出一种新型小样本图像集分类方法——深度类特定协同表示(DCSCR)网络,可同时学习每个图像集的帧级与概念级特征表示,并计算不同集合间的距离相似性。DCSCR包含全卷积深度特征提取模块、全局特征学习模块及基于类特定协同表示的度量学习模块。前两个模块用于学习局部与全局特征,第三个模块则通过新的基于CSCR的对比损失函数,自适应地学习概念级特征表示,从而获得集合间距离相似性。在多个知名小样本ISC数据集上的大量实验表明,该方法显著优于现有先进算法。

原文摘要 · Abstract (English)

Image set classification (ISC), which can be viewed as a task of comparing similarities between sets consisting of unordered heterogeneous images with variable quantities and qualities, has attracted growing research attention in recent years. How to learn effective feature representations and how to explore the similarities between different image sets are two key yet challenging issues in this field. However, existing traditional ISC methods classify image sets based on raw pixel features, ignoring the importance of feature learning. Existing deep ISC methods can learn deep features, but they fail to adaptively adjust the features when measuring set distances, resulting in limited performance in few-shot ISC. To address the above issues, this paper combines traditional ISC methods with deep models and proposes a novel few-shot ISC approach called Deep Class-specific Collaborative Representation (DCSCR) network to simultaneously learn the frame- and concept-level feature representations of each image set and the distance similarities between different sets. Specifically, DCSCR consists of a fully convolutional deep feature extractor module, a global feature learning module, and a class-specific collaborative representation-based metric learning module. The deep feature extractor and global feature learning modules are used to learn (local and global) frame-level feature representations, while the class-specific collaborative representation-based metric learning module is exploit to adaptively learn the concept-level feature representation of each image set and thus obtain the distance similarities between different sets by developing a new CSCR-based contrastive loss function. Extensive experiments on several well-known few-shot ISC datasets demonstrate the effectiveness of the proposed method compared with some state-of-the-art image set classification algorithms.

图像集分类小样本学习深度学习特征表示

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。