arXiv:2512.12543cs.LG2025-12被引 2

通过重要神经元剪枝提升模型微调效果

Effective Fine-Tuning with Eigenvector Centrality Based Pruning

  • 基于特征向量中心性筛选关键神经元进行剪枝
  • 在Oxford Flowers102上达到48%准确率,优于基线30%
  • 适合需要高效微调的轻量化部署场景

社交网络中少数高影响力用户的行为变化可引发大规模话语传播。类似现象也出现在神经网络微调中:传统方法在大型预训练模型上添加新分类层,而本文提出先剪枝保留关键神经元再微调。该方法将每个神经元视为节点,边表示神经元间相似性,依据特征向量中心性计算重要性得分进行剪枝。在VGGNet、EfficientNet和ResNet上使用TF Flowers、Caltech-101和Oxford Flowers102数据集验证,结果表明该方法在显著降低模型复杂度的同时提升分类准确率。在Oxford Flowers102上,剪枝后模型达到48%准确率,远超基线VGGNet的30%。

原文摘要 · Abstract (English)

In social media networks a small number of highly influential users can drive large scale changes in discourse across multiple communities. Small shifts in the behavior of these users are often sufficient to propagate widely throughout the network. A similar phenomenon occurs during neural network fine tuning. Conventional fine tuning of convolutional neural networks typically adds a new linear classification layer on top of a large pre trained model. Instead we argue that improved adaptation can be achieved by first pruning the network to retain only the most important neurons and then performing fine tuning. We propose a graph theory based method for pruning neural networks that is designed to improve fine tuning performance. In this method each neuron is represented as a node and edges encode similarity between neurons. Neurons are pruned based on importance scores computed using eigenvector centrality. The resulting pruned network is then fine tuned using only the most central neurons. We evaluate the proposed method on VGGNet EfficientNet and ResNet models using the TF Flowers Caltech one zero one and Oxford Flowers one zero two datasets. The proposed approach achieves higher classification accuracy while significantly reducing model complexity. On the Oxford Flowers one zero two dataset the method achieves forty eight percent classification accuracy compared to thirty percent accuracy obtained by the baseline VGGNet model.

神经网络剪枝微调优化图论方法特征向量中心性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。