用卷积自编码器+深度滤波器提升纹理识别,无需复杂计算。
A self-supervised learning approach to deep filter banks for texture recognition
- 用卷积自编码器做自监督预训练,适合纹理局部特征。
- 结合深度滤波器与Fisher向量池化,提升特征表达能力。
- 在多个数据集上表现优于主流方法,且计算开销低。
纹理识别面临真实场景中训练数据有限的挑战。为缓解此问题,计算机视觉常采用自监督预训练,如掩码自编码器。但这类模型多依赖计算量大的架构(如视觉变压器)。针对纹理图像信息集中于像素邻域的特点,本文提出基于卷积自编码器的预训练框架,避免冗余长程依赖建模。通过引入深度滤波器与Fisher向量池化,充分挖掘纹理模式蕴含的丰富信息,在不显著增加计算负担的前提下,提升了纹理识别性能。在多个纹理数据库上的实验表明,该方法在分类准确率和计算复杂度方面均优于现有先进方法。
原文摘要 · Abstract (English)
An important challenge in texture recognition is the limited amount of data for training frequently found in real-world applications. In computer vision in general, a successful strategy to mitigate this issue is the use of a pretraining stage where the neural network learns to identify relations between parts of the data in a self-supervised manner. A well-established framework in this direction is masked autoencoder. Nevertheless, these models usually rely on computationally intensive architectures, such as vision transformers. In the particular case of texture images, most of the relevant information is compacted within a delimited area around each pixel, which suggests that capturing long-range dependence via the attention mechanism may be unnecessary. Based on that assumption, here we propose a framework where the pretraining model is a convolutional autoencoder. To leverage the rich information conveyed by texture patterns, we employ deep filters coupled with Fisher vector pooling. In this way, we improve the performance of texture recognition without adding significant computational burden. Our approach is compared with several state-of-the-art methods in different texture databases, confirming its potential both in terms of classification accuracy and computational complexity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。