arXiv:2603.10410cs.LGcs.AI2026-03被引 1

提出首个针对时空数据的双向压缩蒸馏方法,显著提升预测训练效率。

Effective Dataset Distillation for Spatio-Temporal Forecasting with Bi-dimensional Compression

  • 双向压缩时空维度,平衡降低数据量与信息损失
  • 在5个真实数据集上实现最高6倍加速、8倍内存节省、误差降低12%
  • 适合需要高效训练的交通、气象等时空预测场景

时空序列广泛应用于交通预测和天气预报等实际场景,其数据具有多位置、长周期的特性,天然表现为多维结构。预测是时空分析的核心任务,已有大量深度学习方法被提出。然而随着数据规模和模型复杂度增长,训练成本急剧上升。数据蒸馏可生成紧凑数据集替代原始数据进行训练,是一种有前景的解决方案。现有方法仅压缩单一维度,难以适配同时包含空间与时间特征的时空数据。为此,我们提出STemDist,首个专用于时空预测的数据蒸馏方法。核心思想是均衡压缩时空两个维度,大幅减少训练时间和内存占用。通过在聚类层面而非单点层面进行蒸馏进一步降低计算开销,并结合子集级细粒度蒸馏提升预测精度。在五个真实数据集上验证表明,相比通用及时间序列蒸馏方法,本方法使模型训练速度最快提升6倍,内存消耗最多降低8倍,预测误差最低下降12%。

原文摘要 · Abstract (English)

Spatio-temporal time series are widely used in real-world applications, including traffic prediction and weather forecasting. They are sequences of observations over extensive periods and multiple locations, naturally represented as multidimensional data. Forecasting is a central task in spatio-temporal analysis, and numerous deep learning methods have been developed to address it. However, as dataset sizes and model complexities continue to grow in practice, training deep learning models has become increasingly time- and resource-intensive. A promising solution to this challenge is dataset distillation, which synthesizes compact datasets that can effectively replace the original data for model training. Although successful in various domains, including time series analysis, existing dataset distillation methods compress only one dimension, making them less suitable for spatio-temporal datasets, where both spatial and temporal dimensions jointly contribute to the large data volume. To address this limitation, we propose STemDist, the first dataset distillation method specialized for spatio-temporal time series forecasting. A key idea of our solution is to compress both temporal and spatial dimensions in a balanced manner, reducing training time and memory. We further reduce the distillation cost by performing distillation at the cluster level rather than the individual location level, and we complement this coarse-grained approach with a subset-based granular distillation technique that enhances forecasting performance. On five real-world datasets, we show empirically that, compared to both general and time-series dataset distillation methods, datasets distilled by our STemDist method enable model training (1) faster (up to 6X) (2) more memory-efficient (up to 8X), and (3) more effective (with up to 12% lower prediction error).

时空预测数据蒸馏高效训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。