arXiv:2606.22634cs.CVcs.LG2026-06

用学习熵生成图像紧凑表示,提升分类性能

Learning Entropy Signature for Image Representation and Classification

  • 从局部像素顺序学习中提取高学习活性位置
  • 仅保留前K个最高学习熵位置即具强判别力
  • 适合关注神经网络学习机制与图像表征的读者

学习熵(LE)最近通过空间学习熵图(SLEM)拓展至图像分析,SLEM是二维学习活动分布,能突出图像中异常高的学习活跃区域。与传统图像描述子不同,SLEM由预训练前馈MLP网络逐样本、按固定空间顺序处理局部像素邻域来生成,以预测中心像素。因此,每个位置的学习活动不仅依赖局部结构,还受先前处理位置知识的影响。本文提出学习熵签名(LES),基于SLEM中K个最大学习熵位置构建图像描述子,捕捉学习相关结构的空间组织,并根据神经权重行为提供图像内容的紧凑表示。在图像分类任务上的实验表明,少量K个最大学习熵位置即可保留大量判别信息。结果揭示了神经权重学习与信息相关性之间的紧密联系,将学习熵的应用从时间序列扩展至图像内部,实现从结构点提取到紧凑图像表示与分类的演进。

原文摘要 · Abstract (English)

Learning Entropy (LE) has recently been extended to image analysis through Spatial Learning Entropy Maps (SLEMs), which are two-dimensional LE distributions that highlight unusually high learning activity across an image. Unlike conventional image descriptors, SLEMs are generated by incremental, sample-wise learning of a pretrained feedforward MLP network, where local pixel neighborhoods are presented sequentially in a fixed spatial order to predict the corresponding central pixels. Consequently, the learning activity at each image location depends not only on its local structure but also on the knowledge acquired from previously processed locations. This paper introduces Learning Entropy Signatures (LES), an image descriptor derived from SLEM using the K largest LE locations. LES captures the spatial organization of learning-relevant image structures and provides a compact representation of image content based on learning weight behavior. Experimental evaluation on image classification tasks shows that a relatively small number of K largest LE locations preserve substantial discriminative information. The results indicate a close relationship between the learning of neural weights and information relevance, extending the role of Learning Entropy from time series to images and, within images, from structural point extraction to compact image representation and classification.

图像表示学习熵特征提取

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。