将医学影像纹理特征融入轻量模型,实现高精度可解释分割
RadiomicNet: A Hybrid Radiomics-Guided Lightweight Architecture for Interpretable Medical Image Segmentation

- 双流架构融合手工提取的纹理特征与深度网络
- 在乳腺超声和结肠镜数据集上达0.763和0.854的Dice分数
- 仅327万参数,且关键特征贡献可解释,适合临床部署
深度学习在医学图像分割中表现优异,但存在数学不可解释、参数量大、缺乏临床可解释性等问题。本文提出RadiomicNet,一种基于MobileNetV2的轻量级双流混合架构,通过引入手工提取的灰度共生矩阵(GLCM)和局部二值模式(LBP)特征,利用辐射组学注意力门(RAG)调节跳跃连接的注意力,实现分割前的可解释性。设计新型辐射组学一致性损失,使纹理复杂度与预测不确定性对齐,将预期校准误差(ECE)从0.142降至0.118。在乳腺超声图像(BUSI)数据集上获得0.763±0.231的骰子相似系数,在Kvasir-SEG数据集上达0.854±0.112,分别优于U-KAN 1.2%和1.8%(p<0.05,Wilcoxon符号秩检验),参数量仅327万,为标准U-Net的1/9.5,U-KAN的1/4.3。梯度重要性分析显示,GLCM差异性(15.24%)、能量(14.56%)和LBP熵(11.49%)是主要判别依据,提供临床可理解的决策解释。
原文摘要 · Abstract (English)
Deep learning has achieved remarkable performance in medical image segmentation, yet it suffers from critical limitations: mathematical intractability, substantial parameter requirements, and lack of clinical interpretability. We propose RadiomicNet, a novel two-stream hybrid architecture that enhances standard deep learning by integrating handcrafted radiomics features directly into the segmentation learning process. The key contribution is the Radiomics Attention Gate (RAG), which leverages Gray-Level Co-occurrence Matrix (GLCM) and Local Binary Pattern (LBP) features to modulate skip-connection attention in a lightweight MobileNetV2-based encoder-decoder, providing ante-hoc interpretability without post-hoc approximations. A novel Radiomics Consistency Loss further enforces alignment between texture complexity and prediction uncertainty, reducing Expected Calibration Error (ECE) from 0.142 to 0.118. RadiomicNet achieves a Dice Similarity Coefficient (DSC) of 0.763 +/- 0.231 on the Breast Ultrasound Images (BUSI) dataset and 0.854 +/- 0.112 on Kvasir-SEG, outperforming U-KAN by 1.2% and 1.8%, respectively (p < 0.05, Wilcoxon signed-rank test), with only 3.27M parameters, 9.5x fewer than standard U-Net and 4.3x fewer than U-KAN. Gradient-based feature importance analysis reveals that GLCM dissimilarity (15.24%), GLCM energy (14.56%), and LBP entropy (11.49%) are the dominant radiomics cues, providing clinically meaningful explanations for segmentation decisions. The proposed approach demonstrates that compact, interpretable models grounded in domain knowledge can deliver state-of-the-art segmentation performance with substantially reduced computational overhead.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。