解决模型在长期测试中因数据漂移导致性能下降的问题
RDumb++: Drift-Aware Continual Test-Time Adaptation
- 引入熵与KL散度双机制检测数据漂移
- 自适应重置策略使模型在750万样本流上保持3%准确率提升
- 适合需要长期稳定部署的实时推理场景
持续测试时自适应(CTTA)旨在仅使用流入的无标签数据流,在部署过程中更新预训练模型。尽管先前方法如Tent、EATA等在短时分布偏移下表现良好,但在测试分布快速变化或极长时间跨度下仍表现不佳。这一挑战在CCC基准中尤为突出:模型需处理包含750万样本的数据流,其中污染类型和严重程度持续变化。本文提出RDumb++,作为RDumb的合理扩展,引入两种漂移检测机制——基于熵的漂移评分与基于KL散度的漂移评分,并结合自适应重置策略。该机制可识别累积适应带来的危害性,提前恢复以避免预测崩溃。在包含三种速度与三组随机种子的CCC-medium基准上(共九次运行,每次一百万样本),RDumb++始终优于RDumb,实现约3%的绝对准确率提升,且在整个数据流中保持稳定适应。消融实验表明,漂移感知重置对防止崩溃、实现可靠长时序CTTA至关重要。
原文摘要 · Abstract (English)
Continual Test-Time Adaptation (CTTA) seeks to update a pretrained model during deployment using only the incoming, unlabeled data stream. Although prior approaches such as Tent, EATA etc. provide meaningful improvements under short evolving shifts, they struggle when the test distribution changes rapidly or over extremely long horizons. This challenge is exemplified by the CCC benchmark, where models operate over streams of 7.5M samples with continually changing corruption types and severities. We propose RDumb++, a principled extension of RDumb that introduces two drift-detection mechanisms i.e entropy-based drift scoring and KL-divergence drift scoring, together with adaptive reset strategies. These mechanisms allow the model to detect when accumulated adaptation becomes harmful and to recover before prediction collapse occurs. Across CCC-medium with three speeds and three seeds (nine runs, each containing one million samples), RDumb++ consistently surpasses RDumb, yielding approx 3% absolute accuracy gains while maintaining stable adaptation throughout the entire stream. Ablation experiments on drift thresholds and reset strengths further show that drift-aware resetting is essential for preventing collapse and achieving reliable long-horizon CTTA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。