提出跨提示基础模型,解决时间序列隐私域适应难题
Black-Box Time-Series Domain Adaptation via Cross-Prompt Foundation Models
- 设计双分支提示结构,分别捕捉时间序列分布特征
- 在三个不同领域的数据集上显著优于现有方法
- 适用于隐私敏感场景下的时间序列跨域迁移
黑盒域适应(BBDA)旨在解决仅能通过源模型API进行域适应的隐私与安全问题。尽管该领域受关注日益增加,但现有工作多聚焦视觉应用,难以直接用于具有独特时空特性的时间序列任务。此外,尚未有研究探索基础模型在黑盒时间序列域适应(BBTSDA)中的潜力。本文提出跨提示基础模型(CPFM),采用双分支网络结构,每个分支配备独立提示以捕捉数据分布的不同特征。在域适应阶段,引入提示级与输入级的重建学习机制,依托时间序列基础模型克服时空动态性。严谨实验表明,CPFM在三个不同应用领域的时序数据集上均显著优于对比方法。
原文摘要 · Abstract (English)
The black-box domain adaptation (BBDA) topic is developed to address the privacy and security issues where only an application programming interface (API) of the source model is available for domain adaptations. Although the BBDA topic has attracted growing research attentions, existing works mostly target the vision applications and are not directly applicable to the time-series applications possessing unique spatio-temporal characteristics. In addition, none of existing approaches have explored the strength of foundation model for black box time-series domain adaptation (BBTSDA). This paper proposes a concept of Cross-Prompt Foundation Model (CPFM) for the BBTSDA problems. CPFM is constructed under a dual branch network structure where each branch is equipped with a unique prompt to capture different characteristics of data distributions. In the domain adaptation phase, the reconstruction learning phase in the prompt and input levels is developed. All of which are built upon a time-series foundation model to overcome the spatio-temporal dynamic. Our rigorous experiments substantiate the advantage of CPFM achieving improved results with noticeable margins from its competitors in three time-series datasets of different application domains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。