AutoSTF解耦时空搜索,提速13倍还更准。
AutoSTF: Decoupled Neural Architecture Search for Cost-Effective Automated Spatio-Temporal Forecasting
- 将时空搜索拆解为独立的时序与空间空间,减少参数爆炸。
- 在8个数据集上实现最高13.48倍加速,精度领先。
- 适合需要高效精准预测的智慧城市场景。
时空预测是交通优化、能源管理与社会经济分析等智慧城市应用的关键。现有自动化方法虽能自动搜索最优神经网络架构以捕捉复杂时空依赖,但搜索开销大,限制了实际应用和细粒度时空算子探索。本文提出AutoSTF,一种解耦的低成本自动化时空预测神经架构搜索框架。从效率角度,将混合搜索空间解耦为时序与空间空间,并分别设计表示压缩与参数共享策略,缓解参数爆炸问题。解耦的时空搜索不仅加快优化过程,也为更有效的时空依赖建模留出空间。从效果角度,提出多块迁移模块联合捕获多粒度时序依赖,并扩展空间搜索空间,支持更细粒度的逐层空间依赖搜索。在八个数据集上的大量实验表明,AutoSTF在准确率与效率上均具优势:相比当前最优方法,最快提升达13.48倍,同时保持最佳预测精度。
原文摘要 · Abstract (English)
Spatio-temporal forecasting is a critical component of various smart city applications, such as transportation optimization, energy management, and socio-economic analysis. Recently, several automated spatio-temporal forecasting methods have been proposed to automatically search the optimal neural network architecture for capturing complex spatio-temporal dependencies. However, the existing automated approaches suffer from expensive neural architecture search overhead, which hinders their practical use and the further exploration of diverse spatio-temporal operators in a finer granularity. In this paper, we propose AutoSTF, a decoupled automatic neural architecture search framework for cost-effective automated spatio-temporal forecasting. From the efficiency perspective, we first decouple the mixed search space into temporal space and spatial space and respectively devise representation compression and parameter-sharing schemes to mitigate the parameter explosion. The decoupled spatio-temporal search not only expedites the model optimization process but also leaves new room for more effective spatio-temporal dependency modeling. From the effectiveness perspective, we propose a multi-patch transfer module to jointly capture multi-granularity temporal dependencies and extend the spatial search space to enable finer-grained layer-wise spatial dependency search. Extensive experiments on eight datasets demonstrate the superiority of AutoSTF in terms of both accuracy and efficiency. Specifically, our proposed method achieves up to 13.48x speed-up compared to state-of-the-art automatic spatio-temporal forecasting methods while maintaining the best forecasting accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。