无需源数据,用风格提示调优实现跨域少样本学习
Step-wise Distribution Alignment Guided Style Prompt Tuning for Source-free Cross-domain Few-shot Learning
- 通过分步分布对齐优化预测分布,隐式缩小域间差异
- 在5个数据集上超越现有提示调优方法和主流模型
- 适合资源受限场景下快速适配新领域的少样本任务
现有跨域少样本学习方法依赖源域训练策略,但在大规模预训练模型场景下因源数据与训练策略不可访问而面临挑战。微调大模型又需大量计算资源,实用性受限。本文针对无源域跨域少样本学习(SF-CDFSL)问题,仅使用预训练模型和少量目标域样本,在不依赖源数据与策略的前提下实现目标域少样本学习。提出分步分布对齐引导的风格提示调优(StepSPT),通过风格提示使目标样本预测分布逼近理想分布,并采用内外双阶段优化:外部通过分步分布对齐将分布优化分解为多步对齐问题以调优提示;内部使用标准交叉熵更新分类器。在五个数据集上的实验表明,StepSPT优于现有提示调优方法及当前最优模型。消融实验证实其有效性。代码将公开于https://github.com/xuhuali-mxj/StepSPT。
原文摘要 · Abstract (English)
Existing cross-domain few-shot learning (CDFSL) methods, which develop source-domain training strategies to enhance model transferability, face challenges with large-scale pre-trained models (LMs) due to inaccessible source data and training strategies. Moreover, fine-tuning LMs for CDFSL demands substantial computational resources, limiting practicality. This paper addresses the source-free CDFSL (SF-CDFSL) problem, tackling few-shot learning (FSL) in the target domain using only pre-trained models and a few target samples without source data or strategies. To overcome the challenge of inaccessible source data, this paper introduces Step-wise Distribution Alignment Guided Style Prompt Tuning (StepSPT), which implicitly narrows domain gaps through prediction distribution optimization. StepSPT proposes a style prompt to align target samples with the desired distribution and adopts a dual-phase optimization process. In the external process, a step-wise distribution alignment strategy factorizes prediction distribution optimization into a multi-step alignment problem to tune the style prompt. In the internal process, the classifier is updated using standard cross-entropy loss. Evaluations on five datasets demonstrate that StepSPT outperforms existing prompt tuning-based methods and SOTAs. Ablation studies further verify its effectiveness. Code will be made publicly available at https://github.com/xuhuali-mxj/StepSPT.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。