arXiv:2602.04054cs.LGcs.CV2026-02

提出新指标SEIS,可分离神经网络中等变与不变特征,揭示训练如何影响空间结构保持。

SEIS: Subspace-based Equivariance and Invariance Scores for Neural Representations

  • 基于子空间分析,无须标签即可分离特征对几何变换的等变与不变性。
  • 卷积网络前几层强等变,后期逐渐变不变;解码器后层等变性恢复。
  • 数据增强和多任务学习能协同提升等变与不变性,适用于模型设计与训练优化研究。

理解神经表示对几何变换的响应对于评估其是否保留有意义的空间结构至关重要。现有方法主要通过比较变换输入下的模型输出来评估鲁棒性,难以揭示内部表示中几何信息的组织方式,也无法区分信息丢失与重新编码。本文提出SEIS(基于子空间的等变与不变性评分),一种用于分析层间特征表示在几何变换下的子空间度量,无需标签或变换知识即可分离等变性与不变性。在多种架构上的受控实验揭示若干一致模式:首先,卷积编码器呈现深度方向上从强等变到日益不变的转变,且两者在训练初期数个周期内即趋于稳定;而分割解码器中,后期层常出现等变性的恢复。其次,这种权衡并非内在属性,而是由训练决策塑造:数据增强同时强化等变与不变性,多任务学习则带来超越单一任务的协同增益。将分析扩展至卷积网络之外,发现变压器模型表现出独特的几何行为,而MLP-Mixer则介于二者之间。

原文摘要 · Abstract (English)

Understanding how neural representations respond to geometric transformations is essential for evaluating whether learned features preserve meaningful spatial structure. Existing approaches primarily assess robustness primarily by comparing model outputs under transformed inputs, offering limited insight into how geometric information is organized within internal representations and failing to distinguish between information loss and re-encoding. In this work, we introduce SEIS (Subspace-based Equivariance and Invariance Scores), a subspace metric for analyzing layer-wise feature representations under geometric transformations, disentangling equivariance from invariance without requiring labels or explicit knowledge of the transformation. Through controlled experiments across diverse architectures, we uncover several consistent patterns. First, convolutional encoders exhibit a depth-wise transition from strong equivariance to increasing invariance, with both properties stabilizing within the first few training epochs. In segmentation decoders, however, equivariance tends to recover in later layers. Second, this trade-off is not intrinsic but is shaped by training decisions: data augmentation actively strengthens both equivariance and invariance simultaneously, and multi-task learning induces synergistic gains in both properties beyond what either task achieves alone. Extending our analysis beyond convolutional networks, we find that transformer-based models exhibit distinct geometric behaviors, while MLP-Mixers display intermediate characteristics.

神经网络等变性表征分析训练策略

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。