arXiv:2412.01203cs.CV2024-12CVPR

提出无需模型的糖尿病视网膜病变分级自适应方法,应对数据持续流入场景。

Domain Adaptive Diabetic Retinopathy Grading with Model Absence and Flowing Data

  • 从数据视角重构扰动优化,用生成模型学习扰动函数
  • 在冻结和可训练模型上均优于基线,小批量下仍稳定
  • 适合保护源数据隐私的临床部署,防模型攻击

领域偏移(源域与目标域差异)在临床应用中带来挑战,如糖尿病视网膜病变(DR)分级。尽管考虑了源数据隐私等临床需求,传统迁移方法多为模型中心,易受模型针对性攻击。本文针对临床环境需求,提出在线无模型领域自适应(OMG-DA)新设置——模型不可见且目标数据持续流入。为此,我们提出生成式无对抗样本(GUES)方法,实现数据驱动的自适应。理论上将传统扰动优化重构为生成形式:学习以潜在变量为输入的扰动生成函数。模型实例化时,采用变分自编码器(VAE)表达该函数,编码器通过重参数化技巧预测潜在输入,解码器负责扰动生成。同时,利用显著图作为伪扰动标签,因其既能捕捉潜在病灶,又理论上提供函数输入的上界,支持潜在变量识别。在多个DR基准上,对冻结预训练模型与可训练模型进行大量对比实验,结果表明GUES性能优越,即使在小批量情况下仍具鲁棒性。

原文摘要 · Abstract (English)

Domain shift (the difference between source and target domains) poses a significant challenge in clinical applications, e.g., Diabetic Retinopathy (DR) grading. Despite considering certain clinical requirements, like source data privacy, conventional transfer methods are predominantly model-centered and often struggle to prevent model-targeted attacks. In this paper, we address a challenging Online Model-aGnostic Domain Adaptation (OMG-DA) setting, driven by the demands of clinical environments. This setting is characterized by the absence of the model and the flow of target data. To tackle the new challenge, we propose a novel approach, Generative Unadversarial ExampleS (GUES), which enables adaptation from a data-centric perspective. Specifically, we first theoretically reformulate conventional perturbation optimization in a generative way--learning a perturbation generation function with a latent input variable. During model instantiation, we leverage a Variational AutoEncoder to express this function. The encoder with the reparameterization trick predicts the latent input, whilst the decoder is responsible for the generation. Furthermore, the saliency map is selected as pseudo-perturbation labels. Because it not only captures potential lesions but also theoretically provides an upper bound on the function input, enabling the identification of the latent variable. Extensive comparative experiments on DR benchmarks with both frozen pre-trained models and trainable models demonstrate the superiority of GUES, showing robustness even with small batch size.

领域自适应医疗图像生成模型隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。