用模糊逻辑动态调整知识蒸馏权重,提升肺癌检测准确率与实时性
Dynamic Weight Adjustment for Knowledge Distillation: Leveraging Vision Transformer for High-Accuracy Lung Cancer Detection and Real-Time Deployment
- 通过模糊逻辑动态调节蒸馏权重,聚焦高置信区域,抑制模糊区域干扰
- 在两个数据集上分别达到99.16%和99.54%准确率,跨模态表现稳健
- 结合遗传算法选最优学生模型,兼顾性能与计算效率,适合临床部署
本文提出FuzzyDistillViT-MobileNet模型,一种基于动态模糊逻辑驱动知识蒸馏的肺癌分类方法,以应对疾病诊断中的不确定性与复杂性。不同于传统静态蒸馏权重,本方法利用模糊逻辑动态调整蒸馏权重,使学生模型聚焦于高置信区域,减少对模糊区域的关注,从而更好处理图像中不同区域的不确定性。采用ViT-B32作为教师模型,将知识高效迁移至MobileNet学生模型,增强泛化能力。训练过程引入动态等待调整机制,优化收敛速度与性能。为提升图像质量,应用伽马校正与直方图均衡化,并通过小波融合方法(使用wavedec2函数)标准化图像至224x224分辨率,分解多尺度频域成分并递归平均系数,以增强特征保留与图像分辨率。为平衡性能与计算开销,使用遗传算法从12个候选预训练学生模型中筛选最优组合。模型在两个数据集上评估:包含99.16%准确率的LC25000组织病理图像,以及99.54%准确率的IQOTH/NCCD CT扫描图像,展现出跨成像模态的鲁棒性。
原文摘要 · Abstract (English)
This paper presents the FuzzyDistillViT-MobileNet model, a novel approach for lung cancer (LC) classification, leveraging dynamic fuzzy logic-driven knowledge distillation (KD) to address uncertainty and complexity in disease diagnosis. Unlike traditional models that rely on static KD with fixed weights, our method dynamically adjusts the distillation weight using fuzzy logic, enabling the student model to focus on high-confidence regions while reducing attention to ambiguous areas. This dynamic adjustment improves the model ability to handle varying uncertainty levels across different regions of LC images. We employ the Vision Transformer (ViT-B32) as the instructor model, which effectively transfers knowledge to the student model, MobileNet, enhancing the student generalization capabilities. The training process is further optimized using a dynamic wait adjustment mechanism that adapts the training procedure for improved convergence and performance. To enhance image quality, we introduce pixel-level image fusion improvement techniques such as Gamma correction and Histogram Equalization. The processed images (Pix1 and Pix2) are fused using a wavelet-based fusion method to improve image resolution and feature preservation. This fusion method uses the wavedec2 function to standardize images to a 224x224 resolution, decompose them into multi-scale frequency components, and recursively average coefficients at each level for better feature representation. To address computational efficiency, Genetic Algorithm (GA) is used to select the most suitable pre-trained student model from a pool of 12 candidates, balancing model performance with computational cost. The model is evaluated on two datasets, including LC25000 histopathological images (99.16% accuracy) and IQOTH/NCCD CT-scan images (99.54% accuracy), demonstrating robustness across different imaging domains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。