arXiv:2607.07513cs.LGmath.ST2026-07

解释了数据增强如何让半监督学习用更少标签达到高精度。

Fast Rates for Semi-Supervised Learning via Data-Augmentation Graph Regularization

  • 通过增强生成相似图,实现图拉普拉斯正则化学习。
  • 标签数越少,精度下降速度比传统方法快一倍,达1/n_L阶。
  • 揭示了增强质量对效果的关键影响,适合研究半监督学习者。

自监督学习仅需少量标注样本即可达到监督学习的准确率,但其标签高效性的理论机制长期未明。本文提出:数据增强在无标签数据上构建相似性图,下游学习即为图拉普拉斯正则化学习。我们证明了快速的归纳速率 $O(1/n_L)$,优于传统监督学习的 $O(1/ oot{n_L})$,将 Johnson 与 Zhang(JMLR 2007)的 leave-one-out 稳定性框架扩展至增强图,并避免了极限分析中不切实际的假设(如精确核函数、可泛化的特征)。该界明确体现了增强质量的影响:期望误差不超过 $C/n_L + R_{\mathrm{DA}}(y)$,其中数据增强对齐误差 $R_{\mathrm{DA}}(y)$ 与跨越标签边界的增强图割质量成正比,优质增强可显著减少所需标签数。分析采用简化损失函数,省去投影器、负样本和正交性开销,仍能在无限数据下恢复顶-K 理想特征——即 Zhai 等人研究的增强核特征空间。该界从机制上解释了准确率随标签数量变化的曲线,且在可控模型中验证了常数已知情况下的有效性。

原文摘要 · Abstract (English)

Self-supervised learning matches supervised accuracy from a fraction of the labels, but the labeled-sample efficiency behind this has lacked a theoretical explanation. We provide one. Data augmentation induces a similarity graph on the unlabeled data, so downstream learning on that graph is graph-Laplacian-regularized learning. We prove a fast transductive rate, $O(1/n_L)$ in the number of labels, in place of the supervised $O(1/\sqrt{n_L})$, by carrying the leave-one-out stability apparatus of Johnson and Zhang (JMLR 2007) over to the augmentation graph, and without the unrealistic assumptions of limit-based analyses (exact kernel, generalizing features). The bound makes augmentation quality explicit: the expected error is at most $C/n_L + R_{\mathrm{DA}}(y)$, where the data-augmentation alignment error $R_{\mathrm{DA}}(y)$ is proportional to the graph-cut mass of augmentations that cross a label boundary, so good augmentations let few labels suffice. The analysis uses a streamlined loss that drops the projector, negative-sample, and orthogonality overhead of standard objectives yet still recovers the top-$K$ ideal features in the infinite-data limit, the augmentation-kernel eigenspace studied by Zhai et al. The bound gives a mechanistic account of the accuracy-versus-label-count curve through augmentation quality, verified in a controlled model where the constants are known.

半监督学习数据增强理论分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。