通过数学平坦化抵抗严重标签噪声和领域漂移,实现稳定持续学习。
FlatManifold: Robust Continual Learning under Severe Label Noise and Domain Shifts via Intrinsic Manifold Flattening
- 用核方法映射特征到正交空间,自动平滑噪声影响。
- 在40%对称标签噪声下仍保持梯度稳定,性能远超基线。
- 适合机器人等真实场景中长期学习,抗干扰能力强。
在非平稳流式环境中,同时应对复杂非线性领域漂移并缓解严重且未校准的标签噪声带来的灾难性影响,构成根本性数学挑战。本文提出 latmanifold{},一种新型简化鲁棒持续学习框架,基于Nyström流形平坦化映射,结合核技巧与正交化再生核希尔伯特空间(RKHS)投影。该方法不依赖复杂易错的样本过滤流程,而是利用平坦空间本身的内在数学鲁棒性。通过将特征分布映射至固定正交目标拓扑,并引入岭正则化,优化过程自然平滑并抵消极端标签噪声的影响。同时,通过利用过往经验的协方差矩阵设计持续拓扑刹车项,有效防止灾难性遗忘。在真实多时段机器人数据集上的大量实验表明,即使在40%对称标签噪声条件下,latmanifold{}成功缓解了梯度污染;在跨越不同季节与光照条件的极端跨会话领域漂移下,仍展现出卓越泛化能力,显著优于标准序列优化基线,证明结构线性化本身即可成为对抗分布式标签污染的强大数学屏障。
原文摘要 · Abstract (English)
In non-stationary streaming environments, simultaneously adapting to complex, non-linear domain shifts via continual learning while mitigating the catastrophic effects of severe, uncalibrated label noise poses a fundamental mathematical challenge. In this paper, we propose \FlatManifold{}, a novel, streamlined robust continual learning framework that utilizes a Nyström manifold flattening map based on the kernel trick and projection onto an orthogonalized Reproducing Kernel Hilbert Space (RKHS). Unlike traditional methods that rely on complex, error-prone sample-filtering pipelines, the proposed approach exploits the intrinsic mathematical robustness of the flattened space itself. By mapping feature distributions onto a fixed orthogonal target topology with a ridge regularizer, the framework naturally smoothes and counteracts the influence of extreme label noise during the optimization process. Concurrently, catastrophic forgetting is prevented via a continual topology brake term that leverages the covariance matrix of past experiences. Extensive evaluation on real-world multi-session robotics datasets demonstrates that even under severe conditions featuring 40\% symmetric label noise, \FlatManifold{} successfully mitigates gradient corruption. Under extreme cross-session domain shifts spanning various seasons and lighting conditions, the proposed framework establishes high generalization capabilities, significantly outperforming standard sequential optimization baselines and proving that structural linearization itself serves as a powerful mathematical barrier against distributed label corruption.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。