自监督学习难同时提升泛化与判别能力,新方法用博弈论指导优化。
Rethinking Generalizability and Discriminability of Self-Supervised Learning from Evolutionary Game Theory Perspective
- 从演化博弈论视角重构自监督学习,建立性能权衡的理论框架。
- 实验证明所提方法在多个基准上达到最优,兼具强泛化与判别性。
- 适合关注自监督表示质量与理论机制的研究者。
自监督学习获得的表征通常被认为具备足够的泛化性和判别性。然而,我们通过探索性实验揭示了这两项关键属性之间存在非平凡的互斥关系:当前先进方法倾向于增强其中一项,而非两者兼得。因此,同时获得强泛化与判别能力是自监督学习的一大挑战。为此,我们从演化博弈论(EGT)视角重新审视自监督学习范式,构建实现二者权衡的理论路径。尽管EGT擅长通过动态系统建模分析双人博弈的平衡点,但其分析依赖充足标注数据,这违背了自监督学习无标注的核心原则。为提升方法普适性,我们提出一种新自监督学习方法,结合强化学习进展,利用EGT的宏观指导,分阶段优化模型,使特定目标域的预训练过程持续提升泛化性与判别性。理论上,该方法收紧了自监督学习的泛化误差上界;实证上,在多个基准上取得最先进性能。
原文摘要 · Abstract (English)
Representations learned by self-supervised approaches are generally considered to possess sufficient generalizability and discriminability. However, we disclose a nontrivial mutual-exclusion relationship between these critical representation properties through an exploratory demonstration on self-supervised learning. State-of-the-art self-supervised methods tend to enhance either generalizability or discriminability but not both simultaneously. Thus, learning representations jointly possessing strong generalizability and discriminability presents a specific challenge for self-supervised learning. To this end, we revisit the learning paradigm of self-supervised learning from the perspective of evolutionary game theory (EGT) and outline the theoretical roadmap to achieve a desired trade-off between these representation properties. EGT performs well in analyzing the trade-off point in a two-player game by utilizing dynamic system modeling. However, the EGT analysis requires sufficient annotated data, which contradicts the principle of self-supervised learning, i.e., the EGT analysis cannot be conducted without the annotations of the specific target domain for self-supervised learning. Thus, to enhance the methodological generalization, we propose a novel self-supervised learning method that leverages advancements in reinforcement learning to jointly benefit from the general guidance of EGT and sequentially optimize the model to chase the consistent improvement of generalizability and discriminability for specific target domains during pre-training. Theoretically, we establish that the proposed method tightens the generalization error upper bound of self-supervised learning. Empirically, our method achieves state-of-the-art performance on various benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。