提出自适应权重融合方法,解决增量分割中旧知识遗忘问题。
AWF: Adaptive Weight Fusion for Enhanced Class Incremental Semantic Segmentation
- 通过交替训练动态调整权重融合参数,实现更灵活的知识整合。
- 在多个基准数据集上显著优于原有EWF方法,提升分割准确率。
- 适合需要持续学习新类别的视觉场景,如自动驾驶与机器人感知。
类别增量语义分割(CISS)旨在通过平衡已学知识与新引入知识来缓解灾难性遗忘。现有方法主要依赖知识蒸馏等正则化技术,虽能保留旧知识,但常难以有效整合新知识,导致整体性能提升有限。端点权重融合(EWF)方法通过动态融合前后阶段模型权重,利用由旧类与新类数量比决定的融合参数alpha,简化了这一过程。然而,alpha的简单计算可能无法充分捕捉不同任务场景的复杂性,导致融合效果不佳。本文提出自适应权重融合(AWF)方法,引入融合参数的交替训练策略,实现更灵活、自适应的权重整合。AWF通过更好平衡旧知识保留与新类学习,在多个基准CISS任务上显著超越原始EWF,取得更优性能。相关实验代码将开源于Github。
原文摘要 · Abstract (English)
Class Incremental Semantic Segmentation (CISS) aims to mitigate catastrophic forgetting by maintaining a balance between previously learned and newly introduced knowledge. Existing methods, primarily based on regularization techniques like knowledge distillation, help preserve old knowledge but often face challenges in effectively integrating new knowledge, resulting in limited overall improvement. Endpoints Weight Fusion (EWF) method, while simple, effectively addresses some of these limitations by dynamically fusing the model weights from previous steps with those from the current step, using a fusion parameter alpha determined by the relative number of previously known classes and newly introduced classes. However, the simplicity of the alpha calculation may limit its ability to fully capture the complexities of different task scenarios, potentially leading to suboptimal fusion outcomes. In this paper, we propose an enhanced approach called Adaptive Weight Fusion (AWF), which introduces an alternating training strategy for the fusion parameter, allowing for more flexible and adaptive weight integration. AWF achieves superior performance by better balancing the retention of old knowledge with the learning of new classes, significantly improving results on benchmark CISS tasks compared to the original EWF. And our experiment code will be released on Github.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。