arXiv:2411.01432cs.CV2024-11NeurIPS被引 14

通过分解图像频域特征,提升跨域少样本学习的泛化能力

Meta-Exploiting Frequency Prior for Cross-Domain Few-Shot Learning

  • 将查询图像分解为高频与低频成分,同步融入特征网络
  • 在多个跨域少样本数据集上达到新最优性能
  • 无需额外计算开销,适合实际部署场景

元学习为少样本学习(FSL)提供了有前景的解决方案,通过在源域上合成的FSL任务进行周期性训练,使模型获得可迁移的特征嵌入。然而,在目标任务与源域差异较大的实际场景中,基于元学习的方法容易过拟合。为此,我们提出一种新框架——面向跨域少样本学习的元频域先验利用方法,旨在全面利用图像可分解为互补的低频内容细节与高频鲁棒结构特征这一跨域可迁移先验。受此启发,我们将每个查询图像分解为高低频成分,并行输入特征嵌入网络以增强类别预测。更重要的是,引入特征重建先验与预测一致性先验,分别促使原始图像与其频域分量在中间特征和最终分类结果上保持一致。该机制共同引导网络元学习过程,以学习更具泛化性的图像特征嵌入,且推理阶段不增加任何计算成本。本框架在多个跨域少样本学习基准上取得新最优结果。

原文摘要 · Abstract (English)

Meta-learning offers a promising avenue for few-shot learning (FSL), enabling models to glean a generalizable feature embedding through episodic training on synthetic FSL tasks in a source domain. Yet, in practical scenarios where the target task diverges from that in the source domain, meta-learning based method is susceptible to over-fitting. To overcome this, we introduce a novel framework, Meta-Exploiting Frequency Prior for Cross-Domain Few-Shot Learning, which is crafted to comprehensively exploit the cross-domain transferable image prior that each image can be decomposed into complementary low-frequency content details and high-frequency robust structural characteristics. Motivated by this insight, we propose to decompose each query image into its high-frequency and low-frequency components, and parallel incorporate them into the feature embedding network to enhance the final category prediction. More importantly, we introduce a feature reconstruction prior and a prediction consistency prior to separately encourage the consistency of the intermediate feature as well as the final category prediction between the original query image and its decomposed frequency components. This allows for collectively guiding the network's meta-learning process with the aim of learning generalizable image feature embeddings, while not introducing any extra computational cost in the inference phase. Our framework establishes new state-of-the-art results on multiple cross-domain few-shot learning benchmarks.

少样本学习跨域迁移频域先验

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。