arXiv:2509.11884cs.CV2025-09中稿 · ACM MM 25被引 5

通过反向参数配置与测试时训练,提升SAM在伪装目标检测中的语义理解能力。

SAM-TTT: Segment Anything Model via Reverse Parameter Configuration and Test-Time Training for Camouflaged Object Detection

  • 反向参数配置抑制有害参数,无需训练即可优化SAM
  • 引入测试时训练层增强优势特征,实现线性复杂度的序列建模
  • 在多个伪装目标检测数据集上达到新最佳性能,适合视觉任务研究者

本文提出一种新型分割一切模型(SAM-TTT),通过反向参数配置与测试时训练,提升其在伪装目标检测(COD)任务中的表现。现有基于SAM的COD方法多聚焦于提取有利特征和放大优势参数,但忽略了损害语义理解的不利参数。为此,提出反向SAM参数配置模块,在无需训练的前提下调节参数以削弱不良影响;在此基础上,引入专为语言任务设计的测试时训练层,构建T-Visioner模块,将其融入视觉任务,利用线性复杂度与高表达力的隐藏状态增强关键特征。SAM-TTT同时抑制不利参数并强化优势参数,显著提升语义理解能力。在多个COD基准测试中,该方法取得领先性能,确立新基准。代码将公开于https://github.com/guobaoxiao/SAM-TTT。

原文摘要 · Abstract (English)

This paper introduces a new Segment Anything Model (SAM) that leverages reverse parameter configuration and test-time training to enhance its performance on Camouflaged Object Detection (COD), named SAM-TTT. While most existing SAM-based COD models primarily focus on enhancing SAM by extracting favorable features and amplifying its advantageous parameters, a crucial gap is identified: insufficient attention to adverse parameters that impair SAM's semantic understanding in downstream tasks. To tackle this issue, the Reverse SAM Parameter Configuration Module is proposed to effectively mitigate the influence of adverse parameters in a train-free manner by configuring SAM's parameters. Building on this foundation, the T-Visioner Module is unveiled to strengthen advantageous parameters by integrating Test-Time Training layers, originally developed for language tasks, into vision tasks. Test-Time Training layers represent a new class of sequence modeling layers characterized by linear complexity and an expressive hidden state. By integrating two modules, SAM-TTT simultaneously suppresses adverse parameters while reinforcing advantageous ones, significantly improving SAM's semantic understanding in COD task. Our experimental results on various COD benchmarks demonstrate that the proposed approach achieves state-of-the-art performance, setting a new benchmark in the field. The code will be available at https://github.com/guobaoxiao/SAM-TTT.

伪装检测SAM改进测试时训练视觉建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。