arXiv:2507.03175cs.LGcs.AI2025-07综述被引 4

梳理知识迁移能力评估方法,帮研究者选对工具提升迁移效果。

Understanding Knowledge Transferability for Transfer Learning: A Survey

  • 按可迁移知识类型与测量粒度,统一分类迁移性评估指标。
  • 分析各类指标在不同学习范式下的适用性与表现差异。
  • 适合关注迁移学习可靠性与模型选择的研究者阅读。

迁移学习已成为人工智能的重要范式,通过预训练和微调等技术,将源任务知识迁移到目标任务以提升性能,已在计算机视觉与自然语言处理等领域取得显著成功。然而,如何可靠评估知识的可迁移性仍是挑战。理解各类迁移性度量的理论基础对迁移学习的成功至关重要。本文提出一个统一的迁移性度量分类体系,基于可迁移知识类型与测量粒度进行分类,系统考察了用于评估源知识迁移潜力的多种指标及其在不同学习范式中的适用性,强调需谨慎选择度量方法。通过揭示不同指标在各种条件下的作用机制,本综述旨在指导研究者与实践者为特定应用选择最合适的度量,推动更高效、可靠、可信的AI系统发展。最后,讨论该领域开放挑战并提出未来研究方向,以促进可信迁移学习中迁移性度量的应用深化。

原文摘要 · Abstract (English)

Transfer learning has become an essential paradigm in artificial intelligence, enabling the transfer of knowledge from a source task to improve performance on a target task. This approach, particularly through techniques such as pretraining and fine-tuning, has seen significant success in fields like computer vision and natural language processing. However, despite its widespread use, how to reliably assess the transferability of knowledge remains a challenge. Understanding the theoretical underpinnings of each transferability metric is critical for ensuring the success of transfer learning. In this survey, we provide a unified taxonomy of transferability metrics, categorizing them based on transferable knowledge types and measurement granularity. This work examines the various metrics developed to evaluate the potential of source knowledge for transfer learning and their applicability across different learning paradigms emphasizing the need for careful selection of these metrics. By offering insights into how different metrics work under varying conditions, this survey aims to guide researchers and practitioners in selecting the most appropriate metric for specific applications, contributing to more efficient, reliable, and trustworthy AI systems. Finally, we discuss some open challenges in this field and propose future research directions to further advance the application of transferability metrics in trustworthy transfer learning.

迁移学习知识迁移评估指标综述

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。