用跨领域知识提升少样本推理,实验证明有效
Reason Analogically via Cross-domain Prior Knowledge: An Empirical Study of Cross-domain Knowledge Transfer for In-Context Learning
- 用跨域示例替代本域专家数据,实现知识迁移
- 超过阈值后,多示例带来显著性能提升
- 关键在修复推理结构,而非语义相似性
现有上下文学习(ICL)依赖本域专家示例,当标注稀缺时效果受限。我们提出不同领域可能共享底层推理结构,即使语义不匹配,源域示例也能改善目标域推理。通过系统实验评估多种检索方法,验证了跨域ICL中条件性正向迁移的可行性。结果表明存在明确的示例吸收阈值:超过该阈值后,正向迁移更可能发生,且增加示例可带来更大收益。进一步分析显示,性能提升源于检索到的跨域示例对推理结构的修复,而非语义提示。研究证实利用跨域知识迁移可有效提升跨域ICL表现,推动社区探索更高效的检索方法。
原文摘要 · Abstract (English)
Despite its success, existing in-context learning (ICL) relies on in-domain expert demonstrations, limiting its applicability when expert annotations are scarce. We posit that different domains may share underlying reasoning structures, enabling source-domain demonstrations to improve target-domain inference despite semantic mismatch. To test this hypothesis, we conduct a comprehensive empirical study of different retrieval methods to validate the feasibility of achieving cross-domain knowledge transfer under the in-context learning setting. Our results demonstrate conditional positive transfer in cross-domain ICL. We identify a clear example absorption threshold: beyond it, positive transfer becomes more likely, and additional demonstrations yield larger gains. Further analysis suggests that these gains stem from reasoning structure repair by retrieved cross-domain examples, rather than semantic cues. Overall, our study validates the feasibility of leveraging cross-domain knowledge transfer to improve cross-domain ICL performance, motivating the community to explore designing more effective retrieval approaches for this novel direction.\footnote{Our implementation is available at https://github.com/littlelaska/ICL-TF4LR}
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。