arXiv:2509.05322cs.CVcs.LG2025-09

用离散曲率剪枝随机连接神经网络,提升新冠肺部影像识别效率

Application of discrete Ricci curvature in pruning randomly wired neural networks: A case study with chest x-ray classification of COVID-19

  • 引入三种边中心度量,基于曲率与中介性筛选关键连接
  • FRC剪枝使模型压缩率高且速度提升显著,性能接近ORC
  • 适用于需高效剪枝的医学图像模型优化,尤其关注计算效率

随机连接神经网络(RWNNs)为研究深度学习中网络拓扑的影响提供了重要平台,可揭示不同连接模式对学习效率和模型性能的影响。本研究考察三种边中心度量:Forman-Ricci曲率(FRC)、Ollivier-Ricci曲率(ORC)和边中介性中心性(EBC),通过保留重要突触(边)并剪除其余部分来压缩RWNN。以新冠肺部X光图像分类任务为基准,训练RWNN并实现网络复杂度降低,同时保持准确率、特异性和敏感性。扩展了此前基于ORC的剪枝工作,引入FRC与EBC,在三个网络生成器(Erdös-Rényi、Watts-Strogatz、Barabási-Albert)上进行对比分析。重点评估FRC是否在计算更高效的前提下达到与ORC相当的剪枝效果。结果表明,基于FRC的剪枝能有效简化网络,带来显著计算优势,同时性能与ORC相当。此外,通过模块化与全局效率分析,揭示了压缩后网络在模块分离与效率之间的权衡。

原文摘要 · Abstract (English)

Randomly Wired Neural Networks (RWNNs) serve as a valuable testbed for investigating the impact of network topology in deep learning by capturing how different connectivity patterns impact both learning efficiency and model performance. At the same time, they provide a natural framework for exploring edge-centric network measures as tools for pruning and optimization. In this study, we investigate three edge-centric network measures: Forman-Ricci curvature (FRC), Ollivier-Ricci curvature (ORC), and edge betweenness centrality (EBC), to compress RWNNs by selectively retaining important synapses (or edges) while pruning the rest. As a baseline, RWNNs are trained for COVID-19 chest x-ray image classification, aiming to reduce network complexity while preserving performance in terms of accuracy, specificity, and sensitivity. We extend prior work on pruning RWNN using ORC by incorporating two additional edge-centric measures, FRC and EBC, across three network generators: Erdös-Rényi (ER) model, Watts-Strogatz (WS) model, and Barabási-Albert (BA) model. We provide a comparative analysis of the pruning performance of the three measures in terms of compression ratio and theoretical speedup. A central focus of our study is to evaluate whether FRC, which is computationally more efficient than ORC, can achieve comparable pruning effectiveness. Along with performance evaluation, we further investigate the structural properties of the pruned networks through modularity and global efficiency, offering insights into the trade-off between modular segregation and network efficiency in compressed RWNNs. Our results provide initial evidence that FRC-based pruning can effectively simplify RWNNs, offering significant computational advantages while maintaining performance comparable to ORC.

神经网络剪枝图神经网络医学图像曲率分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。