轻量大模型+自适应超图解耦时空预测,提升效率与精度
Decoupling Spatio-Temporal Prediction: When Lightweight Large Models Meet Adaptive Hypergraphs
- 分时序与空间两阶段建模,时序用轻量LLM捕获低秩动态
- 空间用自适应超图建模高阶交互,融合门控机制实现精准对齐
- 在多个真实数据集上显著提升性能,适合大规模场景部署
时空预测在交通管理、气候监测、能源调度等领域具有重要意义。然而,现有方法难以在模型表达能力与计算效率间取得平衡,尤其在处理大规模真实数据集时。为此,本文提出STH-SepNet框架,通过解耦时序与空间建模,同时提升效率与精度。其中,时序维度采用轻量级大语言模型捕捉低秩动态;空间维度则利用自适应超图神经网络,动态构建超边以建模复杂高阶交互。通过精心设计的门控机制,实现时序与空间表征的无缝融合。基于多个基准数据集的大规模实验表明,该方法在保持计算高效的同时显著提升预测性能。本工作为真实应用场景提供了可扩展的轻量化解决方案,有效降低计算开销并增强预测能力。代码已公开于https://github.com/SEU-WENJIA/ST-SepNet-Lightweight-LLMs-Meet-Adaptive-Hypergraphs。
原文摘要 · Abstract (English)
Spatio-temporal prediction is a pivotal task with broad applications in traffic management, climate monitoring, energy scheduling, etc. However, existing methodologies often struggle to balance model expressiveness and computational efficiency, especially when scaling to large real-world datasets. To tackle these challenges, we propose STH-SepNet (Spatio-Temporal Hypergraph Separation Networks), a novel framework that decouples temporal and spatial modeling to enhance both efficiency and precision. Therein, the temporal dimension is modeled using lightweight large language models, which effectively capture low-rank temporal dynamics. Concurrently, the spatial dimension is addressed through an adaptive hypergraph neural network, which dynamically constructs hyperedges to model intricate, higher-order interactions. A carefully designed gating mechanism is integrated to seamlessly fuse temporal and spatial representations. By leveraging the fundamental principles of low-rank temporal dynamics and spatial interactions, STH-SepNet offers a pragmatic and scalable solution for spatio-temporal prediction in real-world applications. Extensive experiments on large-scale real-world datasets across multiple benchmarks demonstrate the effectiveness of STH-SepNet in boosting predictive performance while maintaining computational efficiency. This work may provide a promising lightweight framework for spatio-temporal prediction, aiming to reduce computational demands and while enhancing predictive performance. Our code is avaliable at https://github.com/SEU-WENJIA/ST-SepNet-Lightweight-LLMs-Meet-Adaptive-Hypergraphs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。