arXiv:2601.08608cs.CV2026-01

SfMamba通过通道扫描机制提升无源域适应的特征对齐效率。

SfMamba: Efficient Source-Free Domain Adaptation via Selective Scan Modeling

  • 引入通道序列扫描模块,捕捉关键频域特征以实现域不变特征提取。
  • 在多个基准上超越现有方法,在保持参数效率的同时提升性能。
  • 适合需要隐私保护且计算资源受限的跨域迁移场景。

无源域适应(SFDA)解决在无法访问源数据的情况下,将预训练模型适配到未标注目标域的问题,克服了真实应用中数据隐私与存储限制。然而,现有方法在域不变特征学习中面临感知范围与计算效率之间的权衡。近期,Mamba通过其选择性扫描机制实现了线性复杂度下的长程依赖建模,颇具前景。但视觉Mamba(VMamba)仍难以捕捉对域对齐至关重要的通道级频率特性,并在显著域偏移下缺乏空间鲁棒性。为此,我们提出SfMamba框架,充分挖掘无源模型迁移中的稳定依赖关系。SfMamba引入通道级视觉状态空间块,实现通道-序列扫描以提取域不变特征;同时采用语义一致性打乱策略,在2D选择性扫描中扰乱背景块序列,同时保持预测一致性,缓解误差累积。多基准全面评估表明,SfMamba在保持良好参数效率的同时,持续优于现有方法,为SFDA提供了实用解决方案。代码已公开于https://github.com/chenxi52/SfMamba。

原文摘要 · Abstract (English)

Source-free domain adaptation (SFDA) tackles the critical challenge of adapting source-pretrained models to unlabeled target domains without access to source data, overcoming data privacy and storage limitations in real-world applications. However, existing SFDA approaches struggle with the trade-off between perception field and computational efficiency in domain-invariant feature learning. Recently, Mamba has offered a promising solution through its selective scan mechanism, which enables long-range dependency modeling with linear complexity. However, the Visual Mamba (i.e., VMamba) remains limited in capturing channel-wise frequency characteristics critical for domain alignment and maintaining spatial robustness under significant domain shifts. To address these, we propose a framework called SfMamba to fully explore the stable dependency in source-free model transfer. SfMamba introduces Channel-wise Visual State-Space block that enables channel-sequence scanning for domain-invariant feature extraction. In addition, SfMamba involves a Semantic-Consistent Shuffle strategy that disrupts background patch sequences in 2D selective scan while preserving prediction consistency to mitigate error accumulation. Comprehensive evaluations across multiple benchmarks show that SfMamba achieves consistently stronger performance than existing methods while maintaining favorable parameter efficiency, offering a practical solution for SFDA. Our code is available at https://github.com/chenxi52/SfMamba.

域适应Mamba视觉模型高效迁移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。