arXiv:2603.17548cs.LGcs.AI2026-03

提出自适应归一化方法CLeAN,让模型在数据动态变化时持续学习不遗忘。

CLeAN: Continual Learning Adaptive Normalization in Dynamic Environments

  • 用可学习参数+指数移动平均估算全局特征尺度,适应数据流变化。
  • 在两个数据集上验证,显著提升新数据性能并减少灾难性遗忘。
  • 适合处理金融、安防等数据频繁漂移的实时场景。

人工智能系统多依赖静态数据分布,在网络安全、自动驾驶、金融等动态环境中表现不佳。持续学习可通过顺序学习保留旧知识来应对这一问题,但一个关键且未被充分研究的问题是数据归一化。传统方法如最小-最大缩放需访问全部数据,与持续学习的顺序特性矛盾。本文提出持续学习自适应归一化(CLeAN),一种针对表格数据的新型自适应归一化技术。CLeAN通过可学习参数结合指数移动平均(EMA)模块,动态估计全局特征尺度,使模型能适应不断变化的数据分布。在两个数据集上,采用重水库经验回放、A-GEM、EwC等多种持续学习策略进行综合评估,结果表明:CLeAN不仅提升了对新数据的性能,还有效缓解了灾难性遗忘。研究强调了自适应归一化在提升表格数据持续学习稳定性与有效性中的关键作用,为动态环境下的知识保持提供了新思路。

原文摘要 · Abstract (English)

Artificial intelligence systems predominantly rely on static data distributions, making them ineffective in dynamic real-world environments, such as cybersecurity, autonomous transportation, or finance, where data shifts frequently. Continual learning offers a potential solution by enabling models to learn from sequential data while retaining prior knowledge. However, a critical and underexplored issue in this domain is data normalization. Conventional normalization methods, such as min-max scaling, presuppose access to the entire dataset, which is incongruent with the sequential nature of continual learning. In this paper we introduce Continual Learning Adaptive Normalization (CLeAN), a novel adaptive normalization technique designed for continual learning in tabular data. CLeAN involves the estimation of global feature scales using learnable parameters that are updated via an Exponential Moving Average (EMA) module, enabling the model to adapt to evolving data distributions. Through comprehensive evaluations on two datasets and various continual learning strategies, including Resevoir Experience Replay, A-GEM, and EwC we demonstrate that CLeAN not only improves model performance on new data but also mitigates catastrophic forgetting. The findings underscore the importance of adaptive normalization in enhancing the stability and effectiveness of tabular data, offering a novel perspective on the use of normalization to preserve knowledge in dynamic learning environments.

持续学习归一化表格数据动态环境

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。