arXiv:2507.08721cs.LGcs.AI2025-07NeurIPS被引 9

为测试时自适应模型设计风险监控系统,提前预警性能崩溃

Monitoring Risks in Test-Time Adaptation

  • 用置信序列扩展统计监测框架,支持无标签测试数据
  • 在多种分布偏移下验证,能准确识别模型失效临界点
  • 适合部署后持续运行的模型,尤其需长期稳定的场景

模型部署后遇到测试数据分布漂移是普遍问题。测试时自适应(TTA)通过仅使用无标签测试数据持续更新模型来缓解此问题,但仅为临时方案。最终模型可能退化至无法使用,需下线重训。为此,本文提出将TTA与风险监控框架结合,通过追踪预测性能,在预设指标被突破时发出警报。具体地,将基于序贯检验的置信序列方法扩展至模型持续更新且无测试标签的场景。该方法实现了对TTA的严格统计风险监控,并在代表性数据集、分布偏移类型及多种TTA方法上验证了有效性。

原文摘要 · Abstract (English)

Encountering shifted data at test time is a ubiquitous challenge when deploying predictive models. Test-time adaptation (TTA) methods address this issue by continuously adapting a deployed model using only unlabeled test data. While TTA can extend the model's lifespan, it is only a temporary solution. Eventually the model might degrade to the point that it must be taken offline and retrained. To detect such points of ultimate failure, we propose pairing TTA with risk monitoring frameworks that track predictive performance and raise alerts when predefined performance criteria are violated. Specifically, we extend existing monitoring tools based on sequential testing with confidence sequences to accommodate scenarios in which the model is updated at test time and no test labels are available to estimate the performance metrics of interest. Our extensions unlock the application of rigorous statistical risk monitoring to TTA, and we demonstrate the effectiveness of our proposed TTA monitoring framework across a representative set of datasets, distribution shift types, and TTA methods.

测试时自适应风险监控分布偏移置信序列

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。