arXiv:2507.20997cs.LGcs.AI2025-07

提出可逆模型组合框架,解决持续学习中的干扰与遗忘问题。

Modular Delta Merging with Orthogonal Constraints: A Scalable Framework for Continual and Reversible Model Composition

  • 将微调模型表示为基模型的增量,并投影到正交子空间消除冲突。
  • 在视觉与NLP任务上实现更高准确率、更好回向迁移与更优还原精度。
  • 适合需要合规性删除、模块化更新的工业级AI系统部署。

在实际机器学习应用中,模型需持续更新、组合,必要时可选择性撤销。现有模型融合与持续学习方法常面临任务干扰、灾难性遗忘或缺乏可逆性问题。我们提出模块化增量融合带正交约束(MDM-OC)框架,实现可扩展、无干扰且可逆的微调模型组合。每个任务模型以共享基模型的增量形式编码,并投影至正交子空间以消除冲突。这些投影后的增量通过梯度优化合并,生成统一模型,保持各任务性能。该方法支持新模型持续集成、结构化解耦以满足合规要求(如GDPR),并通过弹性权重巩固和合成重放提升模型稳定性。在视觉与自然语言处理基准上的大量实验表明,MDM-OC在准确率、回向迁移和还原保真度上均优于现有基线,同时保持内存效率与计算可行性。该框架为模块化与合规性人工智能系统设计提供了理论基础。

原文摘要 · Abstract (English)

In real-world machine learning deployments, models must be continually updated, composed, and when required, selectively undone. However, existing approaches to model merging and continual learning often suffer from task interference, catastrophic forgetting, or lack of reversibility. We propose Modular Delta Merging with Orthogonal Constraints (MDM-OC), a novel framework that enables scalable, interference-free, and reversible composition of fine-tuned models. Each task-specific model is encoded as a delta from a shared base and projected into an orthogonal subspace to eliminate conflict. These projected deltas are then merged via gradient-based optimization to form a unified model that retains performance across tasks. Our approach supports continual integration of new models, structured unmerging for compliance such as GDPR requirements, and model stability via elastic weight consolidation and synthetic replay. Extensive experiments on vision and natural language processing benchmarks demonstrate that MDM-OC outperforms prior baselines in accuracy, backward transfer, and unmerge fidelity, while remaining memory-efficient and computationally tractable. This framework offers a principled solution for modular and compliant AI system design.

持续学习模型融合可逆性合规AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。