通过逆尺度稀疏化,让模型专注学大尺度特征以增强抗噪能力。
Robust Network Learning via Inverse Scale Variational Sparsification
- 在连续逆尺度空间中逐级识别像素差异,逐步提取细粒度特征
- 平滑小尺度噪声同时保留纹理和轮廓等高对比度细节
- 适合提升模型对自然噪声、对抗攻击等多种干扰的鲁棒性
尽管神经网络在诸多AI任务中取得显著进展,仍易受多种噪声影响,包括自然退化、对抗噪声和低分辨率伪影。现有方法多针对特定噪声类型提升鲁棒性,泛化能力受限。以往研究从频域视角出发,常导致纹理与物体轮廓等关键特征模糊。本文提出一种基于时间连续逆尺度空间的逆尺度变分稀疏化框架,通过辨别像素间的变分差异,逐步学习更精细尺度特征,最终仅保留平滑图像中的大尺度特征。与频域方法不同,该方法不仅通过平滑小尺度特征去除噪声(通常集中于小尺度),还能有效保持纹理和物体轮廓等高对比度细节。此外,该框架实现简单高效。将其集成至神经网络训练中,可引导模型优先学习大尺度特征。实验表明,该方法在多种噪声类型下均显著提升模型鲁棒性。
原文摘要 · Abstract (English)
While neural networks have made significant strides in many AI tasks, they remain vulnerable to a range of noise types, including natural corruptions, adversarial noise, and low-resolution artifacts. Many existing approaches focus on enhancing robustness against specific noise types, limiting their adaptability to others. Previous studies have addressed general robustness by adopting a spectral perspective, which tends to blur crucial features like texture and object contours. Our proposed solution, however, introduces an inverse scale variational sparsification framework within a time-continuous inverse scale space formulation. This framework progressively learns finer-scale features by discerning variational differences between pixels, ultimately preserving only large-scale features in the smoothed image. Unlike frequency-based methods, our approach not only removes noise by smoothing small-scale features where corruptions often occur but also retains high-contrast details such as textures and object contours. Moreover, our framework offers simplicity and efficiency in implementation. By integrating this algorithm into neural network training, we guide the model to prioritize learning large-scale features. We show the efficacy of our approach through enhanced robustness against various noise types.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。