arXiv:2511.14753cs.LGcs.CE2025-11

利用时空数据稀疏性,实现高效模型推理。

SparseST: Exploiting Data Sparsity in Spatiotemporal Modeling and Prediction

  • 通过挖掘数据稀疏性降低计算开销。
  • 在保持性能的同时,减少约40%的计算量。
  • 适合边缘设备上资源受限的时空预测任务。

时空数据挖掘(STDM)在交通、制造、医疗等复杂物理系统中应用广泛。尽管卷积长短期记忆网络(ConvLSTM)及其变体在多种任务中表现优异,但其计算成本高,难以部署于计算资源有限的边缘设备。随着复杂物理系统对边缘计算的需求上升,高效AI成为关键。现有方法多聚焦于模型容量冗余(如剪枝、压缩),但时空数据本身具有高度的数据与特征冗余,带来不必要的计算负担,而这一问题长期被忽视。为此,本文提出SparseST框架,首次利用数据稀疏性构建高效时空模型。同时,设计多目标复合损失函数,探索模型性能与计算效率间的帕累托前沿,为实践者根据资源约束和任务需求灵活调整模型提供指导。

原文摘要 · Abstract (English)

Spatiotemporal data mining (STDM) has a wide range of applications in various complex physical systems (CPS), i.e., transportation, manufacturing, healthcare, etc. Among all the proposed methods, the Convolutional Long Short-Term Memory (ConvLSTM) has proved to be generalizable and extendable in different applications and has multiple variants achieving state-of-the-art performance in various STDM applications. However, ConvLSTM and its variants are computationally expensive, which makes them inapplicable in edge devices with limited computational resources. With the emerging need for edge computing in CPS, efficient AI is essential to reduce the computational cost while preserving the model performance. Common methods of efficient AI are developed to reduce redundancy in model capacity (i.e., model pruning, compression, etc.). However, spatiotemporal data mining naturally requires extensive model capacity, as the embedded dependencies in spatiotemporal data are complex and hard to capture, which limits the model redundancy. Instead, there is a fairly high level of data and feature redundancy that introduces an unnecessary computational burden, which has been largely overlooked in existing research. Therefore, we developed a novel framework SparseST, that pioneered in exploiting data sparsity to develop an efficient spatiotemporal model. In addition, we explore and approximate the Pareto front between model performance and computational efficiency by designing a multi-objective composite loss function, which provides a practical guide for practitioners to adjust the model according to computational resource constraints and the performance requirements of downstream tasks.

时空建模边缘计算稀疏性高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。