通过概率门控机制提升对比学习的可解释性,解决特征混淆问题。
Bayesian Gated Non-Negative Contrastive Learning

- 引入贝叶斯门控机制,动态过滤无关高频特征,保留语义判别信息。
- 在ImageNet-100上实现比顶尖方法高142.1%的语义一致性提升。
- 适合需要可解释表示的安全关键场景,如医疗影像分析。
尽管对比学习(CL)已革新自监督表征学习,其潜在表示仍高度纠缠且不透明,限制了在安全关键应用中的可解释性。我们发现,这种纠缠的根本原因是依赖确定性相似度度量,对所有特征维度一视同仁。在组合场景中,这导致优化冲突:常见背景特征(如“蓝色天空”)在正样本对中被鼓励对齐,同时在负样本对中又被排斥,引发梯度振荡,阻碍精确的语义解耦。为此,我们提出贝叶斯门控非负对比学习(BayesNCL)。不同于传统方法,BayesNCL引入概率门控机制,动态过滤任务无关的高频公共特征,同时选择性保留判别性语义。通过将特征选择建模为带有稀疏伯努利先验的变分推断问题,该方法有效缓解优化冲突。在ImageNet-100上的实证结果表明,BayesNCL相比现有最优基线实现了142.1%的语义一致性提升,生成高度可解释的表示,且不损害下游任务性能。代码已开源于https://github.com/Cui-Peng-624/BayesNCL。
原文摘要 · Abstract (English)
While Contrastive Learning (CL) has revolutionized self-supervised representation learning, its latent representations remain highly entangled and opaque, limiting their interpretability in safety-critical applications. We identify that a fundamental cause of this entanglement is the reliance on deterministic similarity measures, which treat all feature dimensions equally. In compositional scenes, this creates an Optimization Conflict: common background features, such as, "blue sky", are encouraged to align in positive pairs but simultaneously repelled in negative pairs, causing gradient oscillations that hinder precise semantic disentanglement. To address this, we propose BayesNCL (Bayesian Gated Non-Negative Contrastive Learning). Unlike standard approaches, BayesNCL introduces a probabilistic gating mechanism that dynamically filters out task-irrelevant, high-frequency common features while selectively retaining discriminative semantics. By formalizing feature selection as a variational inference problem with a sparse Bernoulli prior, our method effectively resolves the optimization conflict. Empirical experimental results on Imagenet-100 demonstrate that BayesNCL achieves a remarkable 142.1% improvement in semantic consistency compared to state-of-the-art baselines, yielding highly interpretable representations without compromising downstream task performance. Code is available at https://github.com/Cui-Peng-624/BayesNCL.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。