arXiv:2503.15166cs.CVcs.AI2025-03CVPR被引 1

将机器遗忘引入双曲空间,提升多模态模型概念删除效果。

Machine Unlearning in Hyperbolic vs. Euclidean Multimodal Contrastive Learning: Adapting Alignment Calibration to MERU

  • 在双曲空间中改进对齐校准,实现概念删除
  • 多概念删除时遗忘率接近100%,保留性能良好
  • 适合研究几何表示与可解释性的人看

机器遗忘方法在大型预训练模型中选择性移除特定概念方面愈发重要。尽管已有研究探索了欧氏空间下对比视觉-语言模型的遗忘机制,但双曲空间中的概念删除效果仍未知。本文通过将对齐校准适配至MERU(一种将图像和文本嵌入双曲空间以更好捕捉语义层次的模型),系统研究了双曲对比学习中的机器遗忘。实验与消融分析表明,双曲几何在概念删除上具有显著优势:在多概念删除场景下可实现近乎完美的遗忘,同时保持被保留概念的合理性能。本方法引入了双曲特有组件,包括蕴含校准与范数正则化,充分利用双曲空间特性。与欧氏模型对比发现,双曲遗忘会重构语义层次结构,而欧氏方法仅切断跨模态关联。这些发现不仅推动了机器遗忘技术发展,也揭示了几何属性如何影响多模态模型中的概念表征与删除。源代码见https://github.com/alex-pv01/HAC。

原文摘要 · Abstract (English)

Machine unlearning methods have become increasingly important for selective concept removal in large pre-trained models. While recent work has explored unlearning in Euclidean contrastive vision-language models, the effectiveness of concept removal in hyperbolic spaces remains unexplored. This paper investigates machine unlearning in hyperbolic contrastive learning by adapting Alignment Calibration to MERU, a model that embeds images and text in hyperbolic space to better capture semantic hierarchies. Through systematic experiments and ablation studies, we demonstrate that hyperbolic geometry offers distinct advantages for concept removal, achieving near perfect forgetting with reasonable performance on retained concepts, particularly when scaling to multiple concept removal. Our approach introduces hyperbolic-specific components including entailment calibration and norm regularization that leverage the unique properties of hyperbolic space. Comparative analysis with Euclidean models reveals fundamental differences in unlearning dynamics, with hyperbolic unlearning reorganizing the semantic hierarchy while Euclidean approaches merely disconnect cross-modal associations. These findings not only advance machine unlearning techniques but also provide insights into the geometric properties that influence concept representation and removal in multimodal models. Source code available at https://github.com/alex-pv01/HAC

机器遗忘双曲空间多模态对比学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。