通过主动学习与频域分析,减少医学图像分割的用户点击次数。
ActiveFreq: Integrating Active Learning and Frequency Domain Analysis for Interactive Segmentation
- 根据误标区域重要性排序,智能选择需修正区域
- 引入傅里叶变换模块提取频域特征,增强表征能力
- 仅需两次点击即达85%以上准确率,适合医疗标注场景
交互式分割广泛用于医学图像分析,实现像素级精确标注,通常需要用户反复修正错误区域。但现有方法未能充分利用用户输入知识,也难以全面提取特征。这些方法往往对所有误标区域一视同仁,随机选择进行修正,未评估各区域对分割质量的影响。此外,多数模型仅依赖空间域特征,忽略可提升性能的频域信息。为此,我们提出ActiveFreq框架,融合主动学习与频域分析,以最小化人工干预实现高质量标注。该框架引入AcSelect模块,自动识别最具信息量的误标区域,确保每次点击带来最大性能提升。同时,设计了包含傅里叶变换模块的FreqFormer作为分割主干网络,将特征从空间域映射至频域,实现更丰富的特征提取。在ISIC-2017和OAI-ZIB数据集上的实验表明,ActiveFreq以更少用户交互达到高精度,分别在ISIC-2017上实现3.74次点击@90%精度(NoC@90),在OAI-ZIB上为9.27次,较之前最佳结果分别提升23.5%和12.8%。在极低输入条件下(如仅两点击),其在ISIC-2017和OAI-ZIB上的平均交并比(mIoU)分别达到85.29%和75.76%,展现出高效与精准的交互式医学分割能力。
原文摘要 · Abstract (English)
Interactive segmentation is commonly used in medical image analysis to obtain precise, pixel-level labeling, typically involving iterative user input to correct mislabeled regions. However, existing approaches often fail to fully utilize user knowledge from interactive inputs and achieve comprehensive feature extraction. Specifically, these methods tend to treat all mislabeled regions equally, selecting them randomly for refinement without evaluating each region's potential impact on segmentation quality. Additionally, most models rely solely on spatial domain features, overlooking frequency domain information that could enhance feature extraction and improve performance. To address these limitations, we propose ActiveFreq, a novel interactive segmentation framework that integrates active learning and frequency domain analysis to minimize human intervention while achieving high-quality labeling. ActiveFreq introduces AcSelect, an autonomous module that prioritizes the most informative mislabeled regions, ensuring maximum performance gain from each click. Moreover, we develop FreqFormer, a segmentation backbone incorporating a Fourier transform module to map features from the spatial to the frequency domain, enabling richer feature extraction. Evaluations on the ISIC-2017 and OAI-ZIB datasets demonstrate that ActiveFreq achieves high performance with reduced user interaction, achieving 3.74 NoC@90 on ISIC-2017 and 9.27 NoC@90 on OAI-ZIB, with 23.5% and 12.8% improvements over previous best results, respectively. Under minimal input conditions, such as two clicks, ActiveFreq reaches mIoU scores of 85.29% and 75.76% on ISIC-2017 and OAI-ZIB, highlighting its efficiency and accuracy in interactive medical segmentation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。