构建中间域代理,缓解跨域少样本学习中的语义断层与数据稀疏问题。
Free Lunch to Meet the Gap: Intermediate Domain Reconstruction for Cross-Domain Few-Shot Learning
- 用源域特征做码本,重建目标域特征以构建中间域代理。
- 在8个基准上超越当前最优模型,显著提升跨域少样本性能。
- 适合研究跨域迁移、少样本学习及领域自适应的读者。
跨域少样本学习(CDFSL)旨在仅用少量训练数据,将源域的泛化知识迁移到目标域,但面临语义断层、域间差异大和数据稀缺三大挑战。不同于主流方法聚焦于泛化表征,本文创新性地以源域特征嵌入作为码本,构建中间域代理(IDP),并利用该码本重构目标域特征。我们进一步从视觉风格和语义内容角度对中间域代理的内在属性进行实证分析。借助这些属性,提出一种快速域对齐方法,将中间域代理作为指导,实现目标域特征变换。通过中间域重建与目标特征变换的协同学习,所提模型在8个跨域少样本学习基准上均优于现有最先进方法。
原文摘要 · Abstract (English)
Cross-Domain Few-Shot Learning (CDFSL) endeavors to transfer generalized knowledge from the source domain to target domains using only a minimal amount of training data, which faces a triplet of learning challenges in the meantime, i.e., semantic disjoint, large domain discrepancy, and data scarcity. Different from predominant CDFSL works focused on generalized representations, we make novel attempts to construct Intermediate Domain Proxies (IDP) with source feature embeddings as the codebook and reconstruct the target domain feature with this learned codebook. We then conduct an empirical study to explore the intrinsic attributes from perspectives of visual styles and semantic contents in intermediate domain proxies. Reaping benefits from these attributes of intermediate domains, we develop a fast domain alignment method to use these proxies as learning guidance for target domain feature transformation. With the collaborative learning of intermediate domain reconstruction and target feature transformation, our proposed model is able to surpass the state-of-the-art models by a margin on 8 cross-domain few-shot learning benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。