对比不同模型在眼底图中高血压性视网膜病变检测的性能,发现数据增强对模型影响因架构而异。
Comparative Analysis of Deep Learning Strategies for Hypertensive Retinopathy Detection from Fundus Images: From Scratch and Pre-trained Models
- 用自定义CNN、预训练Transformer和AutoML三种方法对比检测
- 数据增强显著提升纯ViT性能,但降低混合模型表现
- 小块尺寸ViT-B/8在增强数据上表现更好,适合细粒度分析
本文针对眼底图像中的高血压性视网膜病变检测任务,比较了三种深度学习策略:自定义CNN、一系列预训练的基于Transformer的模型以及AutoML方案。研究发现,模型架构对数据增强的响应存在显著差异。数据增强显著提升纯视觉变换器(ViTs)的性能,我们推测这是因为其归纳偏置较弱,迫使模型学习更鲁棒的空间与结构特征;相反,同一增强策略会降低混合型ViT-CNN模型的表现,其来自CNN组件的较强先验可能被变换干扰。较小的块大小(ViT-B/8)在增强数据上表现优异,有助于捕捉细微细节。此外,强大的自监督模型DINOv2在原始小规模数据集上表现不佳,但在数据增强后性能大幅提升,凸显数据多样性对释放其潜力的关键作用。初步测试显示,使用过强容量的ViT-Large模型在专用小数据集上表现差,表明高容量模型在小样本场景中存在风险。本研究为医疗图像分类中模型架构、数据增强与数据集规模之间的相互作用提供了关键洞见。
原文摘要 · Abstract (English)
This paper presents a comparative analysis of deep learning strategies for detecting hypertensive retinopathy from fundus images, a central task in the HRDC challenge~\cite{qian2025hrdc}. We investigate three distinct approaches: a custom CNN, a suite of pre-trained transformer-based models, and an AutoML solution. Our findings reveal a stark, architecture-dependent response to data augmentation. Augmentation significantly boosts the performance of pure Vision Transformers (ViTs), which we hypothesize is due to their weaker inductive biases, forcing them to learn robust spatial and structural features. Conversely, the same augmentation strategy degrades the performance of hybrid ViT-CNN models, whose stronger, pre-existing biases from the CNN component may be "confused" by the transformations. We show that smaller patch sizes (ViT-B/8) excel on augmented data, enhancing fine-grained detail capture. Furthermore, we demonstrate that a powerful self-supervised model like DINOv2 fails on the original, limited dataset but is "rescued" by augmentation, highlighting the critical need for data diversity to unlock its potential. Preliminary tests with a ViT-Large model show poor performance, underscoring the risk of using overly-capacitive models on specialized, smaller datasets. This work provides critical insights into the interplay between model architecture, data augmentation, and dataset size for medical image classification.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。