arXiv:2602.19113cs.LGcs.AI2026-02

动态删减冗余数据,让时空预测模型训练更快更准

Learning from Complexity: Exploring Dynamic Sample Pruning of Spatio-Temporal Training

  • 根据模型学习状态实时筛选关键样本,避免重复计算
  • 在多个真实数据集上训练速度提升显著,性能不降反升
  • 适合大规模时空数据训练,通用性强且易于部署

时空预测是交通、气候科学和城市规划等智能系统的核心。然而,在这些领域中,训练深度学习模型常面临海量且高度冗余的数据带来的巨大计算瓶颈。现有方法多聚焦于优化模型结构或优化器,却忽视了训练数据本身的低效问题。传统方式每轮迭代遍历整个静态数据集,导致大量资源浪费在易学或重复样本上。本文提出一种新颖的训练效率技术——基于复杂度学习的动态样本剪枝(ST-Prune),通过动态筛选模型当前学习状态中最具有信息量的样本,实现加速收敛与提升训练效率。在多个真实时空数据集上的实验表明,ST-Prune 显著加快训练速度,同时保持甚至提升模型性能,且具备良好的可扩展性与通用性。

原文摘要 · Abstract (English)

Spatio-temporal forecasting is fundamental to intelligent systems in transportation, climate science, and urban planning. However, training deep learning models on the massive, often redundant, datasets from these domains presents a significant computational bottleneck. Existing solutions typically focus on optimizing model architectures or optimizers, while overlooking the inherent inefficiency of the training data itself. This conventional approach of iterating over the entire static dataset each epoch wastes considerable resources on easy-to-learn or repetitive samples. In this paper, we explore a novel training-efficiency techniques, namely learning from complexity with dynamic sample pruning, ST-Prune, for spatio-temporal forecasting. Through dynamic sample pruning, we aim to intelligently identify the most informative samples based on the model's real-time learning state, thereby accelerating convergence and improving training efficiency. Extensive experiments conducted on real-world spatio-temporal datasets show that ST-Prune significantly accelerates the training speed while maintaining or even improving the model performance, and it also has scalability and universality.

时空预测动态剪枝训练效率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。