通过分而治之策略,让模型在交互分割中更准地理解用户点击。
DC-TTA: Divide-and-Conquer Framework for Test-Time Adaptation of Interactive Segmentation
- 将用户点击分组,每组独立用TTA更新模型,减少冲突。
- 在复杂场景下用更少点击实现更高精度,优于原始SAM和传统TTA。
- 适合需要精准交互分割的医疗或遥感图像应用。
交互分割(IS)允许用户通过少量提示(如正负点击)迭代优化目标边界。尽管可提示分割模型(SAM)在该领域受到关注,但在特定领域或复杂场景(如伪装物体、多部分物体)中仍表现不佳。为此,我们提出DC-TTA,一种新型测试时自适应(TTA)框架,基于用户交互对SAM进行逐样本自适应。不同于一次性融合所有点击,DC-TTA将点击划分为更一致的子集,每组由独立模型通过TTA处理,实现更局部化的更新。最终融合各子集的适配模型,形成集成预测器,整合各子集的专业知识。在多个基准测试上的实验表明,DC-TTA显著优于SAM零样本性能及传统TTA方法,能以更少交互实现更高的准确性,有效应对伪装物体分割等复杂任务。
原文摘要 · Abstract (English)
Interactive segmentation (IS) allows users to iteratively refine object boundaries with minimal cues, such as positive and negative clicks. While the Segment Anything Model (SAM) has garnered attention in the IS community for its promptable segmentation capabilities, it often struggles in specialized domains or when handling complex scenarios (e.g., camouflaged or multi-part objects). To overcome these challenges, we propose DC-TTA, a novel test-time adaptation (TTA) framework that adapts SAM on a per-sample basis by leveraging user interactions as supervision. Instead of forcing a single model to incorporate all user clicks at once, DC-TTA partitions the clicks into more coherent subsets, each processed independently via TTA with a separated model. This Divide-and-Conquer strategy reduces conflicts among diverse cues and enables more localized updates. Finally, we merge the adapted models to form a unified predictor that integrates the specialized knowledge from each subset. Experimental results across various benchmarks demonstrate that DC-TTA significantly outperforms SAM's zero-shot results and conventional TTA methods, effectively handling complex tasks such as camouflaged object segmentation with fewer interactions and improved accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。