提出平衡软专家混合模型,提升青光眼多模态检测准确率
Balanced Soft mixture-of-expert model for Glaucoma Detection

- 设计三专家软混合架构,引入负载均衡损失解决模态不平衡
- AUC优于所有单模态及当前最优多模态模型
- 方法可推广至糖尿病视网膜病变等其他疾病检测
青光眼是一类损害视神经的眼病,常由眼内压升高引起,是导致不可逆视力丧失的主要原因,且发展缓慢无痛,难以察觉,直至造成严重损伤才被发现。因此早期检测至关重要。近年来,基于深度学习的单模态模型提升了青光眼检测的准确率与效率,辅助医生实现更早诊断、更好监测与及时治疗。在此基础上,多模态模型通过融合不同成像模态优势,学习更丰富、鲁棒的特征表示,进一步提升检测性能。然而,多模态学习面临因联合优化目标导致的模态表征不平衡与欠优化问题。为此,本文提出一种三专家的平衡软专家混合模型,并引入负载均衡损失。实验以AUC为评估指标,所提方法超越所有单模态基线、传统多模态模型及当前最先进的平衡型多模态模型。该方法可推广至糖尿病视网膜病变等其他疾病检测任务。
原文摘要 · Abstract (English)
Glaucoma is a group of eye diseases that damage the optic nerve, often caused by elevated intraocular pressure. It is a leading cause of irreversible vision loss and is typically developed slowly and painlessly, making it difficult to notice until significant damage has occurred. Therefore, early detection is crucial to prevent or slow the progression of vision loss. In recent years, deep learning based uni-modal models have improved the accuracy and efficiency of glaucoma detection, empowering doctors with tools for earlier diagnosis, better monitoring, and timely treatment. Building on this, multi-modal models have emerged, leveraging the strengths of different imaging modalities to learn richer and more robust representations, further enhancing glaucoma detection accuracy. However, multi-modal learning faces challenges such as imbalanced and under-optimized uni-modal representations due to joint learning objectives. To address this, we propose a balanced soft mixture-experts model with three experts and load balancing loss. The performance is measured by AUC, our proposed method surpasses the performance of all uni-modal baselines, conventional multi-modal models, and current stateof- the-art balanced multi-modal models. The proposed model can be generalized to other disease detections such as diabetic retinopathy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。