通过分解重构能力提升时间序列无源域自适应效果
Learning Compositional Transferability of Time Series for Source-Free Domain Adaptation
- 用分层结构分离源域先验与目标域变化,保留预训练模型能力
- 在3个基准上达到最新最优性能,显著优于传统微调方法
- 适合无源数据但需迁移学习的工业时间序列场景
时间序列分类中的域自适应因动态性强而困难。本文针对最棘手的无源域自适应问题(目标标签和源数据均不可见)提出新方法。为复用源域预训练的分类主干,采用时间序列重建来对齐源与目标分布,通过最小化两者重建误差实现。然而,直接在目标数据上微调预训练重建模型会丢失已有先验,且难以适应单一编码器-解码器中的时序模式差异。为此,本文设计一种组合式时间序列重建架构:前段使用冻结的U-net作为预训练主干,输出作为目标序列的粗粒度重建初始值;后续细化阶段包含两个并行分支——源重放分支通过残差连接保留U-net输出,偏移补偿分支引入额外自编码器进一步扭曲其输出;通过可学习因子调节两分支在最终输出中的权重,实现迁移能力的解耦与保留。推理时,在训练批次优化基础上,测试阶段引入稳定感知的重缩放策略以应对实例级波动。实验表明,该组合架构在3个常用基准上达到当前最优表现。
原文摘要 · Abstract (English)
Domain adaptation is challenging for time series classification due to the highly dynamic nature. This study tackles the most difficult subtask when both target labels and source data are inaccessible, namely, source-free domain adaptation. To reuse the classification backbone pre-trained on source data, time series reconstruction is a sound solution that aligns target and source time series by minimizing the reconstruction errors of both. However, simply fine-tuning the source pre-trained reconstruction model on target data may lose the learnt priori, and it struggles to accommodate domain varying temporal patterns in a single encoder-decoder. Therefore, this paper tries to disentangle the composition of domain transferability by using a compositional architecture for time series reconstruction. Here, the preceding component is a U-net frozen since pre-trained, the output of which during adaptation is the initial reconstruction of a given target time series, acting as a coarse step to prompt the subsequent finer adaptation. The following pipeline for finer adaptation includes two parallel branches: The source replay branch using a residual link to preserve the output of U-net, and the offset compensation branch that applies an additional autoencoder (AE) to further warp U-net's output. By deploying a learnable factor on either branch to scale their composition in the final output of reconstruction, the data transferability is disentangled and the learnt reconstructive capability from source data is retained. During inference, aside from the batch-level optimization in the training, we search at test time stability-aware rescaling of source replay branch to tolerate instance-wise variation. The experimental results show that such compositional architecture of time series reconstruction leads to SOTA performance on 3 widely used benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。