针对单样本测试时自适应,提出无需参数更新的对齐方法。
Logit-Origin Centering for Singleton Test-Time Adaptation
- 用运行均值动态调整模型输出逻辑值,不更新权重
- 在五个数据集上显著优于现有基线方法
- 适合部署后持续接收单个样本的实时场景
表格数据广泛应用于实际场景,深度学习模型在测试分布与训练分布不一致时表现不佳。测试时自适应(FTTA)旨在仅使用无标签测试数据调整已部署分类器。主流方法继承了计算机视觉中的批处理依赖策略,在严格流式环境下(逐个样本到达)性能急剧下降,因单样本时无法获取批统计量。本文首次指出,单样本表格式FTTA并非普通FTTA的小批量变体,而是一个可识别性问题:仅能直接观测模型得分序列的位置。为此提出预序逻辑原点中心化(PLOC),保持源模型冻结,每步在逻辑空间中进行平移。PLOC仅需存储一个运行均值,无需标签、先验或参数更新。其延迟变体实现静态偏移,精确保留源模型排序与AUROC。在五个表格基准、三种架构(MLP、FT-Transformer、TabTransformer)及五组独立源检查点上评估,PLOC显著优于强基线方法。
原文摘要 · Abstract (English)
Tabular data is used extensively in many real-world use cases. Deep learning models have been developed to deal with tabular data, but generally perform poorly when the test data distribution differs from that of the training data. Researchers have proposed test-time adaptation approaches to deal with this problem. The fully test-time adaptation (FTTA) setting involves adapting deployed classifiers to shifted target distributions using only unlabeled test data. Leading FTTA methods inherit a batch-dependent approach from computer vision literature. This paper demonstrates for the first time that such approaches degrade sharply in strict streaming regimes where examples arrive and must be classified one at a time. This occurs because at a batch size of one, batch-level statistics become unavailable or poorly estimated. We argue that singleton tabular FTTA is not merely a small-batch variant of ordinary FTTA, but a distinct identifiability problem where only the location of the model's score stream remains directly observable. To address this, we propose Prequential Logit-Origin Centering (PLOC), a lightweight approach that keeps the source model frozen and shifts the logit space at each step. PLOC stores only a single running number (the mean of past logits), requires no labels, estimates no priors, and bypasses weight updates entirely. A deferred variant applies a static shift that preserves the source ranking, and thus the AUROC, exactly. Evaluated across five tabular benchmarks, three architectures (MLP, FT-Transformer, and TabTransformer), and five independent source checkpoints, PLOC significantly outperforms strong tabular and entropy-based baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。