arXiv:2411.10685cs.CV2024-11CVPR被引 8

通过原型到分布的渐进训练,提升图像掩码建模效率与效果。

From Prototypes to General Distributions: An Efficient Curriculum for Masked Image Modeling

  • 先学典型图像样本,再逐步引入复杂变体,优化训练顺序。
  • 在ImageNet-1K上减少训练轮次,同时提升表征质量。
  • 适合追求高效自监督视觉学习的研究者与实践者。

掩码图像建模(Masked Image Modeling, MIM)作为一种强大的自监督学习范式,通过从可见区域预测被遮蔽部分来学习丰富的视觉表征。尽管已取得良好成果,我们推测其有效性受限于早期训练阶段的优化难题:模型需在尚未具备基本视觉处理能力前,就从局部观测中学习复杂的图像分布。为此,我们提出一种基于原型的课程学习框架,将学习过程从典型样本逐步过渡到数据集中的复杂变体。该方法引入温度驱动的退火机制,渐进扩展训练分布,实现更稳定高效的训练轨迹。在ImageNet-1K上的大量实验表明,该课程学习策略显著提升了训练效率与表征质量,且所需训练轮次远少于标准掩码自编码器。研究结果表明,精心控制训练样本顺序对自监督视觉学习至关重要,为MIM的早期优化挑战提供了可行解决方案。

原文摘要 · Abstract (English)

Masked Image Modeling (MIM) has emerged as a powerful self-supervised learning paradigm for visual representation learning, enabling models to acquire rich visual representations by predicting masked portions of images from their visible regions. While this approach has shown promising results, we hypothesize that its effectiveness may be limited by optimization challenges during early training stages, where models are expected to learn complex image distributions from partial observations before developing basic visual processing capabilities. To address this limitation, we propose a prototype-driven curriculum leagrning framework that structures the learning process to progress from prototypical examples to more complex variations in the dataset. Our approach introduces a temperature-based annealing scheme that gradually expands the training distribution, enabling more stable and efficient learning trajectories. Through extensive experiments on ImageNet-1K, we demonstrate that our curriculum learning strategy significantly improves both training efficiency and representation quality while requiring substantially fewer training epochs compared to standard Masked Auto-Encoding. Our findings suggest that carefully controlling the order of training examples plays a crucial role in self-supervised visual learning, providing a practical solution to the early-stage optimization challenges in MIM.

自监督学习图像建模课程学习视觉表征

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。