跨域少样本学习新方法,用知识映射提升模型适应能力
A Cross-Domain Few-Shot Learning Method Based on Domain Knowledge Mapping
- 通过领域知识映射层实现跨域知识迁移
- 在6个不同数据集上验证效果显著优于基线
- 适合需要快速适应新领域任务的场景
在基于任务的少样本学习中,通常假设不同任务独立同分布(i.i.d.)。但在实际应用中,少样本学习所遇到的分布往往与已有数据分布差异显著。如何有效利用已有数据知识,使模型在非i.i.d.条件下快速适应类别变化,成为关键挑战。为此,本文提出一种基于领域知识映射的跨域少样本学习方法,该方法贯穿预训练、训练和测试全过程。预训练阶段,通过最大化互信息融合自监督与监督损失,缓解模式崩溃。训练阶段,领域知识映射层与领域分类器协同,学习领域映射能力和领域适配难度评估。测试阶段,通过支持集上的元训练任务快速适应领域变化,有效提升领域知识迁移能力。在六个来自不同领域的数据集上进行实验验证,结果表明该方法具有显著有效性。
原文摘要 · Abstract (English)
In task-based few-shot learning paradigms, it is commonly assumed that different tasks are independently and identically distributed (i.i.d.). However, in real-world scenarios, the distribution encountered in few-shot learning can significantly differ from the distribution of existing data. Thus, how to effectively leverage existing data knowledge to enable models to quickly adapt to class variations under non-i.i.d. assumptions has emerged as a key research challenge. To address this challenge, this paper proposes a new cross-domain few-shot learning approach based on domain knowledge mapping, applied consistently throughout the pre-training, training, and testing phases. In the pre-training phase, our method integrates self-supervised and supervised losses by maximizing mutual information, thereby mitigating mode collapse. During the training phase, the domain knowledge mapping layer collaborates with a domain classifier to learn both domain mapping capabilities and the ability to assess domain adaptation difficulty. Finally, this approach is applied during the testing phase, rapidly adapting to domain variations through meta-training tasks on support sets, consequently enhancing the model's capability to transfer domain knowledge effectively. Experimental validation conducted across six datasets from diverse domains demonstrates the effectiveness of the proposed method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。