arXiv:2512.11546cs.LGcs.AI2025-12中稿 · ACM SAC 2026

通过优化数据组合,让时间序列模型用更少但更优的数据达到更好效果。

Optimizing the Training Diet: Data Mixture Search for Robust Time Series Forecasting

  • 固定模型,搜索最优数据混合比例以提升性能。
  • 在PMSM数据集上将误差从1.70降至1.37,提升19.41%。
  • 适合需要高效训练的工业传感器建模场景。

传统深度学习训练假设数据越多越好,但原始传感器数据常存在分布不均与冗余问题,非所有数据对泛化有同等贡献。本文提出‘少即是多’的思路:不调模型参数,而是优化训练数据组成。构建一个从大规模未标注时序数据中搜索最优‘训练食谱’的框架。首先用大模型编码并结合k-means聚类,将数据划分为行为一致的若干簇,作为可选‘食材’;再利用Optuna在高维数据混合空间中搜索,每次试验生成各簇的采样比例,构造新训练集,训练小型目标模型并评估。实验表明,该数据驱动方法显著优于全量数据训练基线。在PMSM数据集上,均方误差从1.70降至1.37,提升19.41%。

原文摘要 · Abstract (English)

The standard paradigm for training deep learning models on sensor data assumes that more data is always better. However, raw sensor streams are often imbalanced and contain significant redundancy, meaning that not all data points contribute equally to model generalization. In this paper, we show that, in some cases, "less is more" when considering datasets. We do this by reframing the data selection problem: rather than tuning model hyperparameters, we fix the model and optimize the composition of the training data itself. We introduce a framework for discovering the optimal "training diet" from a large, unlabeled time series corpus. Our framework first uses a large-scale encoder and k-means clustering to partition the dataset into distinct, behaviorally consistent clusters. These clusters represent the fundamental 'ingredients' available for training. We then employ the Optuna optimization framework to search the high-dimensional space of possible data mixtures. For each trial, Optuna proposes a specific sampling ratio for each cluster, and a new training set is constructed based on this recipe. A smaller target model is then trained and evaluated. Our experiments reveal that this data-centric search consistently discovers data mixtures that yield models with significantly higher performance compared to baselines trained on the entire dataset. Specifically - evaluated on PMSM dataset - our method improved performance from a baseline MSE of 1.70 to 1.37, a 19.41% improvement.

时间序列数据优化模型训练传感器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。