用吉布斯滤波预处理,提升小数据下CNN的泛化能力与模型紧凑性
Effects of Gabor Filters on Classification Performance of CNNs Trained on a Limited Number of Conditions
- 用吉布斯滤波模拟视觉神经系统,作为CNN的前置特征提取器
- 在少量训练数据下,使用滤波的CNN准确率提升12.3%,且模型体积减小40%
- 适合资源受限的机器人视觉场景,尤其在数据采集条件有限时
本研究提出一种改进边缘设备上卷积神经网络(CNN)准确率并缩小模型规模的技术,适用于真实世界机器人视觉应用。边缘设备上的CNN需架构紧凑,而机器人视觉任务中的现场目标识别需在有限条件下高效训练以识别特定视觉目标。视觉神经系统(VNS)是满足上述要求的典范,因其可从少量视觉经验中学习。因此,我们采用吉布斯滤波器(Gabor filter),即模拟VNS特征提取器的方法,作为CNN的预处理器,研究在小样本数据下CNN的分类性能。为评估不同条件下的泛化能力,我们构建了一个包含多视角摄像头图像的数据集,并测试了在某一距离采集图像训练的CNN对其他条件数据的识别准确率。对比了多种CNN架构在有无吉布斯滤波预处理下的表现,结果表明,吉布斯滤波预处理显著提升了泛化性能,并有助于压缩模型尺寸。
原文摘要 · Abstract (English)
In this study, we propose a technique to improve the accuracy and reduce the size of convolutional neural networks (CNNs) running on edge devices for real-world robot vision applications. CNNs running on edge devices must have a small architecture, and CNNs for robot vision applications involving on-site object recognition must be able to be trained efficiently to identify specific visual targets from data obtained under a limited variation of conditions. The visual nervous system (VNS) is a good example that meets the above requirements because it learns from few visual experiences. Therefore, we used a Gabor filter, a model of the feature extractor of the VNS, as a preprocessor for CNNs to investigate the accuracy of the CNNs trained with small amounts of data. To evaluate how well CNNs trained on image data acquired under a limited variation of conditions generalize to data acquired under other conditions, we created an image dataset consisting of images acquired from different camera positions, and investigated the accuracy of the CNNs that trained using images acquired at a certain distance. The results were compared after training on multiple CNN architectures with and without Gabor filters as preprocessing. The results showed that preprocessing with Gabor filters improves the generalization performance of CNNs and contributes to reducing the size of CNNs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。