让神经网络的隐藏表示更鲁棒且可解释,通过分组控制特征行为。
Structured Contrastive Learning for Interpretable Latent Representations
- 将隐空间分为不变、可变和自由三类特征,实现可控表达
- ECG相位偏移下相似度从0.25提升至0.91,动作识别准确率达86.65%
- 无需修改模型结构,适合需要可解释性的工业级应用
神经网络对语义无关的变换极度敏感:仅75ms的心电图相位偏移使隐表示余弦相似度从1.0降至0.2,惯性传感器旋转则导致动作识别性能崩溃。我们发现根源在于‘放任式’表征学习——只要任务表现达标,隐空间便不受约束演化。为此提出结构化对比学习(SCL),将隐空间划分为三类语义特征:在特定变换下保持不变的特征(如相位偏移或旋转)、通过新颖可变机制主动区分变换的特征,以及保留任务灵活性的自由特征。该设计形成可调控的推拉机制,使不同隐维度承担可解释的独立功能。可变机制增强对比学习,促使可变特征在正样本对内差异显著,实现鲁棒性与可解释性同步提升。本方法无需架构修改,可无缝集成现有训练流程。在心电图相位不变性与IMU旋转鲁棒性实验中表现优异:心电图相似度由0.25升至0.91,WISDM动作识别达86.65%准确率,旋转一致性达95.38%,持续优于传统数据增强。本工作标志着从被动数据增强向主动结构学习的范式转变,为神经网络提供可解释的隐表示。
原文摘要 · Abstract (English)
Neural networks exhibit severe brittleness to semantically irrelevant transformations. A mere 75ms electrocardiogram (ECG) phase shift degrades latent cosine similarity from 1.0 to 0.2, while sensor rotations collapse activity recognition performance with inertial measurement units (IMUs). We identify the root cause as "laissez-faire" representation learning, where latent spaces evolve unconstrained provided task performance is satisfied. We propose Structured Contrastive Learning (SCL), a framework that partitions latent space representations into three semantic groups: invariant features that remain consistent under given transformations (e.g., phase shifts or rotations), variant features that actively differentiate transformations via a novel variant mechanism, and free features that preserve task flexibility. This creates controllable push-pull dynamics where different latent dimensions serve distinct, interpretable purposes. The variant mechanism enhances contrastive learning by encouraging variant features to differentiate within positive pairs, enabling simultaneous robustness and interpretability. Our approach requires no architectural modifications and integrates seamlessly into existing training pipelines. Experiments on ECG phase invariance and IMU rotation robustness demonstrate superior performance: ECG similarity improves from 0.25 to 0.91 under phase shifts, while WISDM activity recognition achieves 86.65% accuracy with 95.38% rotation consistency, consistently outperforming traditional data augmentation. This work represents a paradigm shift from reactive data augmentation to proactive structural learning, enabling interpretable latent representations in neural networks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。