arXiv:2512.09069cs.CVcs.AI2025-12中稿 · ICSPIS 2025

用知识蒸馏让大模型变小,实现高精度眼底OCT实时筛查。

KD-OCT: Efficient Knowledge Distillation for Clinical-Grade Retinal OCT Classification

  • 用增强数据+焦点损失训练大模型作教师,压缩成轻量学生模型。
  • 学生模型仅1.8MB,推理速度提升9倍,准确率达96.7%。
  • 适合医院部署,助力基层眼科快速筛查老年黄斑病变。

年龄相关性黄斑变性(AMD)和脉络膜新生血管(CNV)是全球致盲主因,光学相干断层扫描(OCT)是早期诊断的核心手段。然而,先进深度学习模型如ConvNeXtV2-Large因计算开销大,难以在临床中实时部署。为此,本文提出新型知识蒸馏框架KD-OCT,将经增强数据、随机权重平均及焦点损失优化的ConvNeXtV2-Large教师模型,压缩为轻量级EfficientNet-B2学生模型,用于正常、软性玻璃疣和CNV三类眼底影像分类。KD-OCT采用实时蒸馏策略,结合软标签知识传递与硬标签监督。在诺尔眼科医院(NEH)数据集上,通过患者级交叉验证评估。结果表明,该方法在效率-精度平衡上优于现有多尺度或特征融合模型,学生模型达到接近教师性能,模型体积减少95%,推理时间降低89%。尽管压缩,其表现仍超越多数现有框架,支持边缘设备部署,适用于AMD筛查。代码已开源:https://github.com/erfan-nourbakhsh/KD-OCT。

原文摘要 · Abstract (English)

Age-related macular degeneration (AMD) and choroidal neovascularization (CNV)-related conditions are leading causes of vision loss worldwide, with optical coherence tomography (OCT) serving as a cornerstone for early detection and management. However, deploying state-of-the-art deep learning models like ConvNeXtV2-Large in clinical settings is hindered by their computational demands. Therefore, it is desirable to develop efficient models that maintain high diagnostic performance while enabling real-time deployment. In this study, a novel knowledge distillation framework, termed KD-OCT, is proposed to compress a high-performance ConvNeXtV2-Large teacher model, enhanced with advanced augmentations, stochastic weight averaging, and focal loss, into a lightweight EfficientNet-B2 student for classifying normal, drusen, and CNV cases. KD-OCT employs real-time distillation with a combined loss balancing soft teacher knowledge transfer and hard ground-truth supervision. The effectiveness of the proposed method is evaluated on the Noor Eye Hospital (NEH) dataset using patient-level cross-validation. Experimental results demonstrate that KD-OCT outperforms comparable multi-scale or feature-fusion OCT classifiers in efficiency-accuracy balance, achieving near-teacher performance with substantial reductions in model size and inference time. Despite the compression, the student model exceeds most existing frameworks, facilitating edge deployment for AMD screening. Code is available at https://github.com/erfan-nourbakhsh/KD-OCT.

医学影像知识蒸馏轻量化模型OCT分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。