用神经记忆微分方程设计轻量解码器,显著减少参数和计算量。
A Lightweight U-like Network Utilizing Neural Memory Ordinary Differential Equations for Slimming the Decoder
- 基于nmODE离散化设计可插拔解码器,融合多层跳连特征。
- 在多个数据集上降低20%~50%参数,最多减少74%计算量。
- 适配各类U型网络,适合资源受限的医疗图像分割场景。
近年来,先进的U型网络在医学图像分割任务中表现优异,但其参数过多、计算复杂度高、推理速度慢等问题限制了在计算资源有限场景下的应用。现有轻量U型网络虽缓解部分问题,但结构预设且模块不可拆分,适用性受限。本文提出三种基于神经记忆常微分方程(nmODEs)不同离散化方法的即插即用解码器,通过处理跳连信息并沿上行路径执行数值运算,实现多层次特征融合。在PH2、ISIC2017和ISIC2018数据集上的实验表明,将这些解码器嵌入不同U型网络后,可显著减少参数量与浮点运算次数(参数减少约20%~50%,FLOPs最高降低74%),同时保持性能。所提离散化nmODE解码器具备兼容所有U型网络的潜力。代码已开源:https://github.com/nayutayuki/Lightweight-nmODE-Decoders-For-U-like-networks。
原文摘要 · Abstract (English)
In recent years, advanced U-like networks have demonstrated remarkable performance in medical image segmentation tasks. However, their drawbacks, including excessive parameters, high computational complexity, and slow inference speed, pose challenges for practical implementation in scenarios with limited computational resources. Existing lightweight U-like networks have alleviated some of these problems, but they often have pre-designed structures and consist of inseparable modules, limiting their application scenarios. In this paper, we propose three plug-and-play decoders by employing different discretization methods of the neural memory Ordinary Differential Equations (nmODEs). These decoders integrate features at various levels of abstraction by processing information from skip connections and performing numerical operations on upward path. Through experiments on the PH2, ISIC2017, and ISIC2018 datasets, we embed these decoders into different U-like networks, demonstrating their effectiveness in significantly reducing the number of parameters and FLOPs while maintaining performance. In summary, the proposed discretized nmODEs decoders are capable of reducing the number of parameters by about 20% ~ 50% and FLOPs by up to 74%, while possessing the potential to adapt to all U-like networks. Our code is available at https://github.com/nayutayuki/Lightweight-nmODE-Decoders-For-U-like-networks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。