系统分析卷积神经网络滤波器设计,揭示其对学习效果的关键影响。
On filter design in deep convolutional neural network
- 提出统一框架分析滤波器初始化与参数选择
- 评估无监督方法在滤波器学习中的有效性
- 适合关注模型优化与可解释性的研究者
深度卷积神经网络(DCNN)在计算机视觉领域取得了显著成果,广泛应用于医疗、农业、自动驾驶和生物识别等场景。滤波器(权重)是决定学习能力的核心要素。尽管反向传播算法表现优异,但滤波器的尺寸与数量仍作为超参数处理,缺乏理论指导。过去十年虽有大量关于半监督、自监督和无监督方法的研究,但滤波器初始化、尺寸形状选择及数量对学习与优化的影响尚未被系统梳理。这些属性常被视为调参项,缺乏数学理解。真实应用中计算机视觉算法仍存局限,深入理解学习过程对突破瓶颈至关重要。本文首次系统探讨滤波器设计问题,比较不同初始化策略与学习技术,评估有前景的无监督方法,并讨论当前挑战与未来方向。
原文摘要 · Abstract (English)
The deep convolutional neural network (DCNN) in computer vision has given promising results. It is widely applied in many areas, from medicine, agriculture, self-driving car, biometric system, and almost all computer vision-based applications. Filters or weights are the critical elements responsible for learning in DCNN. Backpropagation has been the primary learning algorithm for DCNN and provides promising results, but the size and numbers of the filters remain hyper-parameters. Various studies have been done in the last decade on semi-supervised, self-supervised, and unsupervised methods and their properties. The effects of filter initialization, size-shape selection, and the number of filters on learning and optimization have not been investigated in a separate publication to collate all the options. Such attributes are often treated as hyper-parameters and lack mathematical understanding. Computer vision algorithms have many limitations in real-life applications, and understanding the learning process is essential to have some significant improvement. To the best of our knowledge, no separate investigation has been published discussing the filters; this is our primary motivation. This study focuses on arguments for choosing specific physical parameters of filters, initialization, and learning technic over scattered methods. The promising unsupervised approaches have been evaluated. Additionally, the limitations, current challenges, and future scope have been discussed in this paper.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。