arXiv:2602.12696cs.CVcs.LG2026-02

针对多通道影像的特征探测,提出通道感知新方法。

Channel-Aware Probing for Multi-Channel Imaging

  • 分离编码各通道特征,再分通道聚合,提升表征能力
  • 在三个数据集上优于默认探测方式,接近从头微调效果
  • 适合希望高效利用预训练模型的新通道设置场景

在多通道影像(MCI)数据上训练和评估视觉编码器仍具挑战性,因不同数据集的通道配置各异,导致固定通道训练不可行,且预训练编码器难以复用于新通道组合。以往研究虽训练了MCI编码器,但多采用全量微调评估,对冻结预训练编码器的探测研究不足。现有探测方法多关注表示优化,而非如何有效利用固定表示完成下游任务。尽管其他领域已有相关策略,直接迁移到MCI却表现不佳,甚至劣于从头训练。为此,本文提出通道感知探测(CAP),通过在编码器和探测器层面控制特征流动,利用MCI数据固有的通道间多样性。CAP采用独立特征编码(IFE)分别处理各通道,并使用解耦池化(DCP)在通道内池化后再跨通道聚合。在三个MCI基准上,CAP持续优于默认探测协议,性能达到从头微调水平,显著缩小与同源预训练检查点全量微调的差距。

原文摘要 · Abstract (English)

Training and evaluating vision encoders on Multi-Channel Imaging (MCI) data remains challenging as channel configurations vary across datasets, preventing fixed-channel training and limiting reuse of pre-trained encoders on new channel settings. Prior work trains MCI encoders but typically evaluates them via full fine-tuning, leaving probing with frozen pre-trained encoders comparatively underexplored. Existing studies that perform probing largely focus on improving representations, rather than how to best leverage fixed representations for downstream tasks. Although the latter problem has been studied in other domains, directly transferring those strategies to MCI yields weak results, even worse than training from scratch. We therefore propose Channel-Aware Probing (CAP), which exploits the intrinsic inter-channel diversity in MCI datasets by controlling feature flow at both the encoder and probe levels. CAP uses Independent Feature Encoding (IFE) to encode each channel separately, and Decoupled Pooling (DCP) to pool within channels before aggregating across channels. Across three MCI benchmarks, CAP consistently improves probing performance over the default probing protocol, matches fine-tuning from scratch, and largely reduces the gap to full fine-tuning from the same MCI pre-trained checkpoints. Code can be found in https://github.com/umarikkar/CAP.

多通道影像特征探测表征学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。