arXiv:2509.11711cs.CV2025-09NeurIPS被引 2

发现深度卷积网络收敛到8个通用滤波器,可高效实现高精度图像识别。

The Quest for Universal Master Key Filters in DS-CNNs

  • 通过无监督搜索找到8个通用滤波器,覆盖主流深度可分离卷积网络的滤波模式。
  • 仅用这8个冻结滤波器初始化模型,ImageNet准确率超80%,小数据集表现更优。
  • 滤波器结构与生物视觉系统和经典图像处理算子高度一致,具普适性。

近期研究提出卷积神经网络滤波器的“主钥滤波器假说”。本文将该假说扩展为:深度可分离卷积网络(DS-CNN)本质上会收敛到一组仅含8个通用滤波器的极简集合。尽管传统DS-CNN使用数千个独立训练的滤波器,我们的分析表明这些滤波器主要为这8个通用滤波器的线性变换(ax+b)。通过系统性无监督搜索,我们在不同架构和数据集上提取出这些基础模式。令人惊讶的是,仅用这8个固定滤波器初始化的网络在ImageNet上达到超过80%的准确率,且在小数据集上甚至优于含数千可训练参数的模型。所发现的主钥滤波器与差分高斯(DoGs)、高斯及其导数结构高度吻合,这类结构不仅在经典图像处理中至关重要,也与哺乳动物视觉系统的感受野惊人相似。结果表明,无论任务或架构如何,深度卷积层自然趋向于这一基本的空间算子集合。本工作为理解泛化与迁移学习提供了新视角,揭示了主钥滤波器作为通用表征语言的潜力。

原文摘要 · Abstract (English)

A recent study has proposed the "Master Key Filters Hypothesis" for convolutional neural network filters. This paper extends this hypothesis by radically constraining its scope to a single set of just 8 universal filters that depthwise separable convolutional networks inherently converge to. While conventional DS-CNNs employ thousands of distinct trained filters, our analysis reveals these filters are predominantly linear shifts (ax+b) of our discovered universal set. Through systematic unsupervised search, we extracted these fundamental patterns across different architectures and datasets. Remarkably, networks initialized with these 8 unique frozen filters achieve over 80% ImageNet accuracy, and even outperform models with thousands of trainable parameters when applied to smaller datasets. The identified master key filters closely match Difference of Gaussians (DoGs), Gaussians, and their derivatives, structures that are not only fundamental to classical image processing but also strikingly similar to receptive fields in mammalian visual systems. Our findings provide compelling evidence that depthwise convolutional layers naturally gravitate toward this fundamental set of spatial operators regardless of task or architecture. This work offers new insights for understanding generalization and transfer learning through the universal language of these master key filters.

卷积网络通用滤波器图像识别生物启发

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。