通过频率空间分析,解决跨域少样本学习中的数据偏差问题
FreqGRL: Suppressing Low-Frequency Bias and Mining High-Frequency Knowledge for Cross-Domain Few-Shot Learning
- 从频域视角出发,用低频替换和高频增强应对数据不平衡
- 在五个基准上达到当前最优,显著提升跨域泛化能力
- 适合研究少样本学习与领域自适应的学者参考
跨域少样本学习(CD-FSL)旨在面对显著域偏移时,仅用少量标注样本识别新类别。尽管近期方法利用少量目标域标签数据提升性能,但源域数据丰富而目标域数据稀缺所导致的数据不平衡仍是有效表征学习的关键挑战。本文首次从频域角度分析该问题,揭示两大挑战:(1) 模型易受源数据低频成分中编码的源域特定知识影响而产生偏差;(2) 目标数据稀疏性阻碍了高频、通用特征的学习。为此,我们提出新颖的频域引导框架 FreqGRL。具体包括:低频替换(LFR)模块,将源任务的低频成分替换为目标域数据的对应成分,生成更贴近目标特性的新源任务,从而降低源域偏差并促进泛化表征;高频增强(HFE)模块,在频域中滤除低频成分,直接对高频特征进行学习,以增强跨域泛化能力;以及全局频域过滤(GFF)模块,抑制噪声或无关频率,突出信息量高的频率成分,缓解有限目标监督下的过拟合风险。在五个标准CD-FSL基准上的大量实验表明,该频域引导框架实现了当前最优性能。
原文摘要 · Abstract (English)
Cross-domain few-shot learning (CD-FSL) aims to recognize novel classes with only a few labeled examples under significant domain shifts. While recent approaches leverage a limited amount of labeled target-domain data to improve performance, the severe imbalance between abundant source data and scarce target data remains a critical challenge for effective representation learning. We present the first frequency-space perspective to analyze this issue and identify two key challenges: (1) models are easily biased toward source-specific knowledge encoded in the low-frequency components of source data, and (2) the sparsity of target data hinders the learning of high-frequency, domain-generalizable features. To address these challenges, we propose \textbf{FreqGRL}, a novel CD-FSL framework that mitigates the impact of data imbalance in the frequency space. Specifically, we introduce a Low-Frequency Replacement (LFR) module that substitutes the low-frequency components of source tasks with those from the target domain to create new source tasks that better align with target characteristics, thus reducing source-specific biases and promoting generalizable representation learning. We further design a High-Frequency Enhancement (HFE) module that filters out low-frequency components and performs learning directly on high-frequency features in the frequency space to improve cross-domain generalization. Additionally, a Global Frequency Filter (GFF) is incorporated to suppress noisy or irrelevant frequencies and emphasize informative ones, mitigating overfitting risks under limited target supervision. Extensive experiments on five standard CD-FSL benchmarks demonstrate that our frequency-guided framework achieves state-of-the-art performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。