模仿人类视觉发育过程,用渐进模糊提升图像模型鲁棒性。
Mimicking Human Visual Development for Learning Robust Image Representations
- 训练初期用模糊图像,逐步减少模糊以强化全局结构感知。
- 在CIFAR-10-C上降低8.30%的均值损坏误差,ImageNet-100-C上降4.43%。
- 适合追求模型泛化与抗噪能力的研究者和工程应用。
人类视觉系统能有效适应输入分布变化,而现代卷积神经网络(CNN)仍难以匹敌。受人类视觉发育过程启发,我们提出一种渐进式模糊课程训练策略,以提升CNN的泛化与鲁棒性。婴儿出生时视力较差,随时间逐渐掌握细节识别能力。我们模拟这一过程:在训练初期使用高度模糊的图像,随着训练推进逐步降低模糊程度。该方法促使网络优先关注全局结构而非高频噪声,从而增强对分布偏移和噪声输入的鲁棒性。我们驳斥了早期模糊会带来刺激不足并永久损害性能的旧观点,发现早期模糊反而显著提升泛化能力,对域内准确率影响极小。实验表明,在CIFAR-10-C和ImageNet-100-C数据集上,相比标准训练,该方法分别将均值损坏误差(mCE)降低8.30%和4.43%。与静态模糊增强不同,本方法遵循有结构的渐进过程,在多个数据集上保持一致增益。此外,该方法可与CutMix、MixUp等增强技术互补,同时提升自然场景与对抗攻击下的鲁棒性。代码已公开于https://github.com/rajankita/Visual_Acuity_Curriculum。
原文摘要 · Abstract (English)
The human visual system is remarkably adept at adapting to changes in the input distribution; a capability modern convolutional neural networks (CNNs) still struggle to match. Drawing inspiration from the developmental trajectory of human vision, we propose a progressive blurring curriculum to improve the generalization and robustness of CNNs. Human infants are born with poor visual acuity, gradually refining their ability to perceive fine details. Mimicking this process, we begin training CNNs on highly blurred images during the initial epochs and progressively reduce the blur as training advances. This approach encourages the network to prioritize global structures over high-frequency artifacts, improving robustness against distribution shifts and noisy inputs. Challenging prior claims that blurring in the initial training epochs imposes a stimulus deficit and irreversibly harms model performance, we reveal that early-stage blurring enhances generalization with minimal impact on in-domain accuracy. Our experiments demonstrate that the proposed curriculum reduces mean corruption error (mCE) by up to 8.30% on CIFAR-10-C and 4.43% on ImageNet-100-C datasets, compared to standard training without blurring. Unlike static blur-based augmentation, which applies blurred images randomly throughout training, our method follows a structured progression, yielding consistent gains across various datasets. Furthermore, our approach complements other augmentation techniques, such as CutMix and MixUp, and enhances both natural and adversarial robustness against common attack methods. Code is available at https://github.com/rajankita/Visual_Acuity_Curriculum.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。