用大模型判断跨领域时间序列数据质量,自动评分更准更快。
Rating Quality of Diverse Time Series Data by Meta-learning from LLM Judgment
- 借大模型知识理解不同领域时间序列的质量差异
- 在11个数据集上比基线准确率提升,支持跨域适应
- 适合需要高效评估海量异构时间序列的科研与工业场景
高质量时间序列数据对模型性能至关重要,现有方法在单一领域表现良好,但难以应对跨领域、性质多样的真实数据。本文提出TSRating框架,利用大模型预训练中积累的广泛知识,通过设计提示词让大模型对比不同时间序列样本的质量。基于这些判断,训练一个专用评分模型TSRater,通过推断未来序列样本来生成高效质量预测。为增强跨域适应能力,采用元学习在九个不同领域数据上训练,并使用signSGD优化内循环更新,避免计算超梯度的开销。在三个时间序列任务、11个基准数据集上的实验表明,无论使用传统模型还是时间序列基础模型,TSRating在准确性、效率和跨域适应性上均优于基线方法。
原文摘要 · Abstract (English)
High-quality time series (TS) data are essential for ensuring TS model performance, rendering research on rating TS data quality indispensable. Existing methods have shown promising rating accuracy within individual domains, primarily by extending data quality rating techniques such as influence functions and Shapley values to account for temporal characteristics. However, they neglect the fact that real-world TS data can span vastly different domains and exhibit distinct properties, hampering the accurate and efficient rating of diverse TS data. In this paper, we propose TSRating, a novel and unified framework for rating the quality of time series data crawled from diverse domains. TSRating leverages LLMs' inherent ample knowledge, acquired during their extensive pretraining, to comprehend and discern quality differences in diverse TS data. We verify this by devising a series of prompts to elicit quality comparisons from LLMs for pairs of TS samples. We then fit a dedicated rating model, termed TSRater, to convert the LLMs' judgments into efficient quality predictions by inferring future TS samples through TSRater's inference. To ensure cross-domain adaptability, we develop a meta-learning scheme to train TSRater on quality comparisons collected from nine distinct domains. To improve training efficiency, we employ signSGD for inner-loop updates, thus circumventing the demanding computation of hypergradients. Extensive experimental results on eleven benchmark datasets across three time series tasks, each using both conventional TS models and TS foundation models, demonstrate that TSRating outperforms baselines in terms of estimation accuracy, efficiency, and domain adaptability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。