arXiv:2507.22632stat.MLcs.LG2025-07被引 1

首次统一分析半监督域适应的泛化与样本复杂度,揭示深度网络性能瓶颈。

A Unified Analysis of Generalization and Sample Complexity for Semi-Supervised Domain Adaptation

  • 基于域对齐的联合学习框架,结合特征变换与共享分类器。
  • 证明深度网络样本复杂度随深度和宽度平方增长,且需按根号调整目标损失。
  • 理论指导实际训练,适合研究域适应与深度学习理论的学者。

域适应旨在利用源域丰富的标签信息提升目标域有限标签下的分类性能。尽管方法发展迅速,理论基础仍较薄弱。现有分析多限于输入空间相同的简化场景,依赖域间差异度量。本文针对通过特征变换实现域对齐的算法,开展全面理论研究。考虑在半监督设置下联合学习域对齐特征变换与共享分类器,首先基于函数类覆盖数推导泛化界;进一步分析采用最大均值差异(MMD)或对抗目标的神经网络的样本复杂度。结果表明,两类模型的样本复杂度均随网络深度和宽度呈平方关系增长。此外,在半监督设定下,通过将目标损失与标记目标样本数的平方根成比例缩放,可增强对少量标签数据的鲁棒性。浅层与深层实验验证了理论结论。

原文摘要 · Abstract (English)

Domain adaptation seeks to leverage the abundant label information in a source domain to improve classification performance in a target domain with limited labels. While the field has seen extensive methodological development, its theoretical foundations remain relatively underexplored. Most existing theoretical analyses focus on simplified settings where the source and target domains share the same input space and relate target-domain performance to measures of domain discrepancy. Although insightful, these analyses may not fully capture the behavior of modern approaches that align domains into a shared space via feature transformations. In this paper, we present a comprehensive theoretical study of domain adaptation algorithms based on domain alignment. We consider the joint learning of domain-aligning feature transformations and a shared classifier in a semi-supervised setting. We first derive generalization bounds in a broad setting, in terms of covering numbers of the relevant function classes. We then extend our analysis to characterize the sample complexity of domain-adaptive neural networks employing maximum mean discrepancy (MMD) or adversarial objectives. Our results rely on a rigorous analysis of the covering numbers of these architectures. We show that, for both MMD-based and adversarial models, the sample complexity admits an upper bound that scales quadratically with network depth and width. Furthermore, our analysis suggests that in semi-supervised settings, robustness to limited labeled target data can be achieved by scaling the target loss proportionally to the square root of the number of labeled target samples. Experimental evaluation in both shallow and deep settings lends support to our theoretical findings.

域适应深度学习泛化分析样本复杂度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。