arXiv:2505.24558cs.CV2025-05被引 10

改进卷积核权重机制,提升图像分类与去噪性能。

Optimal Weighted Convolution for Classification and Denosing

  • 在卷积中引入空间密度函数,按位置差异加权邻域像素。
  • VGG分类准确率提升至66.94%(原56.89%),DnCNN去噪PSNR达22.63。
  • 兼容现有网络结构,代码开源,适合图像处理研究者使用。

我们提出一种新型加权卷积算子,通过将空间密度函数融入传统卷积,使网络能根据邻近像素相对于参考像素的位置差异进行差异化加权,从而增强空间表征与特征提取能力。该算子保持可训练参数数量不变,且完全兼容现有CNN架构。尽管针对2D图像设计,其框架可推广至任意维度规则网格信号,如3D体数据或1D时间序列。我们通过预计算密度函数实现高效部署,执行时间与标准卷积相当。在CIFAR-100图像分类和DIV2K图像去噪任务上评估,结合VGG、ResNet等主流分类模型及DnCNN、NAFNet等去噪模型,结果表明加权卷积在多项指标上优于标准卷积。例如,VGG分类准确率从56.89%提升至66.94%,DnCNN在去噪任务中PSNR由20.17提升至22.63。所有实验均在CINECA Leonardo集群上训练,以加速调参过程。PyTorch实现已公开于https://github.com/cammarasana123/weightedConvolution2.0。

原文摘要 · Abstract (English)

We introduce a novel weighted convolution operator that enhances traditional convolutional neural networks (CNNs) by integrating a spatial density function into the convolution operator. This extension enables the network to differentially weight neighbouring pixels based on their relative position to the reference pixel, improving spatial characterisation and feature extraction. The proposed operator maintains the same number of trainable parameters and is fully compatible with existing CNN architectures. Although developed for 2D image data, the framework is generalisable to signals on regular grids of arbitrary dimensions, such as 3D volumetric data or 1D time series. We propose an efficient implementation of the weighted convolution by pre-computing the density function and achieving execution times comparable to standard convolution layers. We evaluate our method on two deep learning tasks: image classification using the CIFAR-100 dataset [KH+09] and image denoising using the DIV2K dataset [AT17]. Experimental results with state-of-the-art classification (e.g., VGG [SZ15], ResNet [HZRS16]) and denoising (e.g., DnCNN [ZZC+17], NAFNet [CCZS22]) methods show that the weighted convolution improves performance with respect to standard convolution across different quantitative metrics. For example, VGG achieves an accuracy of 66.94% with weighted convolution versus 56.89% with standard convolution on the classification problem, while DnCNN improves the PSNR value from 20.17 to 22.63 on the denoising problem. All models were trained on the CINECA Leonardo cluster to reduce the execution time and improve the tuning of the density function values. The PyTorch implementation of the weighted convolution is publicly available at: https://github.com/cammarasana123/weightedConvolution2.0.

卷积改进图像去噪特征提取

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。