用学习熵定位图像中对模型训练影响大的关键点。
Learning Entropy and Spatial Adaptation Dynamics of Multilayer Perceptrons for Structural Point Extraction
- 通过分析神经网络权重变化,计算空间学习熵来识别重要区域。
- 学习熵高的区域与传统特征提取结果互补,揭示学习关键点。
- 适合关注模型训练过程、图像分析与机器人感知的研究者。
本文将学习熵(LE)概念从时序自适应系统拓展至多层感知机(MLP)在图像数据中的空间学习分析。不同于依赖梯度或协方差算子的局部邻域方法,该方法通过分析神经网络权重在图像样本上的增量适应过程来评估学习熵。训练一个MLP以从周围上下文预测中心像素强度,同时在学习过程中计算空间学习熵。生成的空间学习熵图(SLEM)可识别出引起网络强适应性的异常点和区域,这些位置在学习过程中具有重要贡献。结果表明,空间学习熵为传统特征提取与可解释性方法提供了互补视角,其关注的是图像点对网络学习的影响程度而非局部结构特性。该框架可能为计算机视觉、制造与机器人领域的学习驱动图像或场景分析开辟新方向。
原文摘要 · Abstract (English)
This paper extends the concept of Learning Entropy (LE) from temporal adaptive systems to spatial learning in multilayer perceptron networks (MLPs) applied to image data. Instead of evaluating image structure directly from gradients or covariance operators, as local neighborhood methods do, the proposed approach analyzes the learning process itself through Learning Entropy. An MLP is trained to predict the intensity of a center pixel from its surrounding spatial context, while LE is evaluated from the incremental adaptation of neural weights during learning across image-derived samples. The resulting Spatial Learning Entropy Maps (SLEM) identify unusual image points and regions that induce strong adaptation of the neural network and therefore have an important role in the learning process. The results indicate that spatial Learning Entropy provides a complementary perspective to conventional feature extraction and explainability methods by highlighting spatial locations that are particularly informative for network learning. Spatial Learning Entropy provides a complementary perspective to conventional feature extraction and explainability methods by identifying image points and regions according to their learning impact rather than their local structural properties. The proposed framework may open new directions for learning-driven image or scene analysis in computer vision, manufacturing, and robotics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。