系统梳理可信迁移学习的理论与方法,解决知识可迁移性与可靠性问题
Trustworthy Transfer Learning: A Survey
- 从可迁移性与可信度双视角重构迁移学习研究框架
- 提出在独立同分布与非独立同分布下量化知识迁移能力的方法
- 涵盖鲁棒性、公平性、隐私保护等可信性关键问题,适合研究者参考
迁移学习旨在将源域的知识或信息迁移到相关目标域。本文从知识可迁移性与可信度两个角度理解迁移学习,提出两个核心问题:如何定量衡量并提升跨域知识可迁移性?能否信任迁移过程中的知识?为此,本文从问题定义、理论分析、经验算法和实际应用多个维度,全面综述可信迁移学习的研究进展。具体包括在独立同分布(IID)与非独立同分布(non-IID)假设下,近期关于知识可迁移性的理论与算法总结。除可迁移性外,还探讨了可信度对迁移学习的影响,例如迁移知识是否具备对抗鲁棒性或算法公平性,如何在隐私保护约束下进行知识迁移等。文章在总结当前进展的同时,也指出了未来实现可靠、可信迁移学习的关键开放问题与方向。
原文摘要 · Abstract (English)
Transfer learning aims to transfer knowledge or information from a source domain to a relevant target domain. In this paper, we understand transfer learning from the perspectives of knowledge transferability and trustworthiness. This involves two research questions: How is knowledge transferability quantitatively measured and enhanced across domains? Can we trust the transferred knowledge in the transfer learning process? To answer these questions, this paper provides a comprehensive review of trustworthy transfer learning from various aspects, including problem definitions, theoretical analysis, empirical algorithms, and real-world applications. Specifically, we summarize recent theories and algorithms for understanding knowledge transferability under (within-domain) IID and non-IID assumptions. In addition to knowledge transferability, we review the impact of trustworthiness on transfer learning, e.g., whether the transferred knowledge is adversarially robust or algorithmically fair, how to transfer the knowledge under privacy-preserving constraints, etc. Beyond discussing the current advancements, we highlight the open questions and future directions for understanding transfer learning in a reliable and trustworthy manner.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。