解决图像编辑模型持续学习中的遗忘问题,提升长期适应能力。
ACE-LoRA: Adaptive Orthogonal Decoupling for Continual Image Editing

- 通过自适应正交解耦识别并分离任务干扰
- 在持续更新中保持高指令准确率与视觉真实感
- 适合需要长期迭代优化的图像编辑场景
当前先进的扩散模型通常依赖参数高效微调实现特定图像编辑任务。然而,现实应用要求模型能持续适应新任务的同时保留已有知识。尽管这一需求迫切,但图像编辑领域的持续学习仍鲜有研究。我们提出ACE-LoRA,一种动态正则化框架,有效缓解灾难性遗忘。该方法利用自适应正交解耦识别并正交化任务干扰,并引入秩不变历史信息压缩策略,解决持续更新中的可扩展性问题。为推动图像编辑中的持续学习并提供标准化评估协议,我们构建了首个综合性基准CIE-Bench,涵盖多样且贴近实际的编辑场景,难度均衡,能有效暴露现有模型局限,同时兼容参数高效微调。大量实验表明,所提方法在指令保真度、视觉真实性和抗遗忘能力上均显著优于现有基线,为图像编辑的持续学习奠定坚实基础。
原文摘要 · Abstract (English)
State-of-the-art diffusion models often rely on parameter-efficient fine-tuning to perform specialized image editing tasks. However, real-world applications require continual adaptation to new tasks while preserving previously learned knowledge. Despite the practical necessity, continual learning for image editing remains largely underexplored. We propose ACE-LoRA, a dynamic regularization framework for continual image editing that effectively mitigates catastrophic forgetting. ACE-LoRA leverages Adaptive Orthogonal Decoupling to identify and orthogonalize task interference, and introduces a Rank-Invariant Historical Information Compression strategy to address scalability issues in continual updates. To facilitate continual learning in image editing and provide a standardized evaluation protocol, we introduce CIE-Bench, the first comprehensive benchmark in this domain. CIE-Bench encompasses diverse and practically relevant image editing scenarios with a balanced level of difficulty to effectively expose limitations of existing models while remaining compatible with parameter-efficient fine-tuning. Extensive experiments demonstrate that our method consistently outperforms existing baselines in terms of instruction fidelity, visual realism, and robustness to forgetting, establishing a strong foundation for continual learning in image editing.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。