arXiv:2607.27087cs.CV2026-07

轻量级模块提升DINOv3特征,高效实现临床眼前段分割

Step-Attention Refinement of DINOv3 Features for Efficient Anterior Eye Segmentation

论文配图:Step-Attention Refinement of DINOv3 Features for Efficient Anterior Eye Segmentation
图 1 · 摘自论文原文
  • 用分步注意力模块逐步优化多层级Transformer特征
  • 在私有数据集上达85.55% mIoU,跨域泛化能力最强
  • 适合需要小参数、强鲁棒性的医疗图像分割场景

眼前段分割是眼科生物识别与临床影像分析的关键环节。然而,医疗环境中成像条件多样且标注有限,制约了现有方法的鲁棒性与泛化能力。基于DINOv3的视觉基础模型虽具备强大迁移能力,但如何高效适配密集预测任务仍具挑战。本文提出一种轻量级架构,基于蒸馏后的DINOv3 ViT-Small主干,引入分步注意力特征精炼模块,在卷积解码前逐级优化多尺度变换器特征,以极少参数高效利用预训练特征。在包含333张临床采集图像的私有数据集上评估,覆盖八种眼科成像协议,标注七类解剖结构。相比卷积与Transformer基线(含DINOv3方法),本方法在全微调下达到85.55% mIoU,且在四个未见公共数据集上展现出最强域偏移鲁棒性。结果为临床场景下的鲁棒眼前段分割建立了强基准,凸显解码器设计对基础模型特征有效适配的重要性。

原文摘要 · Abstract (English)

Anterior eye segment (AES) segmentation is a key component of both ocular biometrics and emerging clinical image analysis applications. However, heterogeneous acquisition conditions and limited annotations in medical settings hinder the robustness and generalization of existing methods. Foundation models (FMs) such as DINOv3 offer strong transfer capabilities, but efficiently adapting their representations to dense prediction tasks remains challenging. In this study, we investigate robust AES segmentation in clinical settings, and propose a lightweight architecture built upon a distilled DINOv3 ViT-Small backbone. We introduce a step-attention feature refinement module that progressively adapts multi-level transformer representations before convolutional decoding, enabling efficient exploitation of pretrained features with few parameters. We evaluate the proposed approach on a private dataset of 333 clinically acquired AES images spanning eight ophthalmic acquisition protocols and annotated for seven anatomical classes. Compared with convolutional and transformer-based baselines, including DINOv3-based methods, our approach achieves the best overall performance, reaching 85.55\% mIoU when fully fine-tuned. It also demonstrates the strongest robustness to domain shift across four unseen public AES segmentation datasets. These results establish a strong baseline for robust AES segmentation in clinical settings and highlight the importance of decoder design for effectively adapting FMs representations to medical segmentation tasks.

医学图像分割视觉基础模型轻量化设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。