arXiv:2505.14105cs.CV2025-05

修复预训练模型在电镜图像分割中的通道偏倚问题

Mitigating Pretraining-Induced Attention Asymmetry in 2D+ Electron Microscopy Image Segmentation

  • 用均匀初始化修正预训练权重,恢复输入切片的对称性
  • 实验显示该方法显著降低特征归因偏差,精度不降反升
  • 适合做电镜图像分割且关注模型可解释性的研究者

基于大规模自然彩色图像预训练的视觉模型广泛用于电子显微镜图像分割。在电镜中,三维数据以连续切片形式获取并处理为相邻灰度切片堆叠,邻近切片对中心切片的特征识别具有对称上下文信息。常见做法是将堆叠映射为伪RGB输入以实现迁移学习,但此映射继承了自然图像的通道语义,而电镜切片在模态上同质、预测角色对称。因此,预训练模型可能编码与电镜数据固有对称性不符的归纳偏置。本工作表明,使用多个架构的基于显著性归因分析发现,尽管无内在通道顺序,预训练模型仍系统性地为不同输入切片赋予不等重要性。这种通道级不对称性在微调后依然存在,影响模型可解释性,即使分割性能不变。为此,提出一种基于均匀通道初始化的目标权重修改方法,恢复对称特征归因,同时保留预训练优势。在SNEMI、Lucchi和GF-PA66数据集上的实验验证,该方法显著减少归因偏差,且未损害甚至提升了分割准确率。

原文摘要 · Abstract (English)

Vision models pretrained on large-scale RGB natural image datasets are widely reused for electron microscopy image segmentation. In electron microscopy, volumetric data are acquired as serial sections and processed as stacks of adjacent grayscale slices, where neighboring slices provide symmetric contextual information for identifying features on the central slice. The common strategy maps such stacks to pseudo-RGB inputs to enable transfer learning from pretrained models. However, this mapping imposes channel-specific semantics inherited from natural images, even though electron microscopy slices are homogeneous in the modality and symmetric in their predictive roles. As a result, pretrained models may encode inductive biases that are misaligned with the inherent symmetry of volumetric electron microscopy data. In this work, it is demonstrated that RGB-pretrained models systematically assign unequal importance to individual input slices when applied to stacked electron microscopy data, despite the absence of any intrinsic channel ordering. Using saliency-based attribution analysis across multiple architectures, a consistent channel-level asymmetry was observed that persists after fine-tuning and affects model interpretability, even when segmentation performance is unchanged. To address this issue, a targeted modification of pretraining weights based on uniform channel initialization was proposed, which restores symmetric feature attribution while preserving the benefits of pretraining. Experiments on the SNEMI, Lucchi and GF-PA66 datasets confirm a substantial reduction in attribution bias without compromising or even improving segmentation accuracy.

图像分割电镜分析模型可解释性预训练模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。