提升少样本学习在复杂环境下的鲁棒性,通过条件特征学习增强模型泛化能力。
Enhancing Environmental Robustness in Few-shot Learning via Conditional Representation Learning
- 设计条件特征学习网络,利用训练与测试图像的交互信息优化特征表示。
- 在多域少样本基准上实现6.83%至16.98%的性能提升,显著优于现有方法。
- 适用于真实场景下目标小、背景杂、模糊等挑战性图像识别任务。
少样本学习(FSL)被广泛用于解决特定领域视觉识别中训练数据不足的问题。在实际应用中,复杂背景、光照变化、远距离拍摄和运动目标等因素常导致测试图像出现目标不完整或噪声干扰。然而,当前评估数据集与方法大多忽视了“环境鲁棒性”这一概念,即模型在复杂多变物理环境中保持稳定性能的能力。这种忽视导致FSL模型在实际测试中的表现远低于训练表现。为此,我们构建了一个新的真实世界多域少样本学习(RD-FSL)基准,包含四个领域和六个评估数据集,测试图像涵盖伪装物体、小目标和模糊等挑战性元素。实验表明,现有方法难以有效利用训练图像生成准确特征表示。为此,我们提出一种新型条件表示学习网络(CRLNet),将训练与测试图像间的交互作为条件信息融入各自表示过程,旨在降低类内差异或增强类间差异。对比实验显示,CRLNet在多种设置和主干网络下均超越当前最优方法,性能提升达6.83%至16.98%。代码与数据集已公开于https://github.com/guoqianyu-alberta/Conditional-Representation-Learning。
原文摘要 · Abstract (English)
Few-shot learning (FSL) has recently been extensively utilized to overcome the scarcity of training data in domain-specific visual recognition. In real-world scenarios, environmental factors such as complex backgrounds, varying lighting conditions, long-distance shooting, and moving targets often cause test images to exhibit numerous incomplete targets or noise disruptions. However, current research on evaluation datasets and methodologies has largely ignored the concept of "environmental robustness", which refers to maintaining consistent performance in complex and diverse physical environments. This neglect has led to a notable decline in the performance of FSL models during practical testing compared to their training performance. To bridge this gap, we introduce a new real-world multi-domain few-shot learning (RD-FSL) benchmark, which includes four domains and six evaluation datasets. The test images in this benchmark feature various challenging elements, such as camouflaged objects, small targets, and blurriness. Our evaluation experiments reveal that existing methods struggle to utilize training images effectively to generate accurate feature representations for challenging test images. To address this problem, we propose a novel conditional representation learning network (CRLNet) that integrates the interactions between training and testing images as conditional information in their respective representation processes. The main goal is to reduce intra-class variance or enhance inter-class variance at the feature representation level. Finally, comparative experiments reveal that CRLNet surpasses the current state-of-the-art methods, achieving performance improvements ranging from 6.83% to 16.98% across diverse settings and backbones. The source code and dataset are available at https://github.com/guoqianyu-alberta/Conditional-Representation-Learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。