arXiv:2507.02939cs.LGcs.AI2025-07ICCV被引 95

用频域对齐知识蒸馏,让轻量模型更好预测时空变化。

Frequency-Aligned Knowledge Distillation for Lightweight Spatiotemporal Forecasting

  • 通过频域分解提取教师模型的多尺度特征,指导学生模型学习。
  • 在纳维-斯托克斯数据集上,MSE降低81.3%,MAE降低52.3%。
  • 适合需要高效实时预测的交通、气象等时空任务。

时空预测任务如交通流、燃烧动力学和天气预报常依赖复杂模型,导致训练效率低且内存消耗高。本文提出轻量化框架Spectral Decoupled Knowledge Distillation(SDKD),将复杂教师模型中的多尺度时空表征迁移至更高效的轻量学生网络。教师模型采用编码器-隐状态演化-解码器结构,其隐状态演化模块利用卷积与Transformer(全局低频建模器)分离高频细节与低频趋势。但多层卷积与反卷积结构造成训练缓慢、内存开销大。为此,我们提出频率对齐知识蒸馏策略,从教师模型隐空间提取包含高低频成分的多尺度谱特征,引导学生模型同时捕捉局部精细变化与全局演化模式。实验表明,SDKD显著提升性能,在纳维-斯托克斯方程数据集上,均方误差(MSE)降低81.3%,平均绝对误差(MAE)降低52.3%。该框架有效捕捉高频波动与长期趋势的同时,大幅降低计算复杂度。代码已公开于https://github.com/itsnotacie/SDKD。

原文摘要 · Abstract (English)

Spatiotemporal forecasting tasks, such as traffic flow, combustion dynamics, and weather forecasting, often require complex models that suffer from low training efficiency and high memory consumption. This paper proposes a lightweight framework, Spectral Decoupled Knowledge Distillation (termed SDKD), which transfers the multi-scale spatiotemporal representations from a complex teacher model to a more efficient lightweight student network. The teacher model follows an encoder-latent evolution-decoder architecture, where its latent evolution module decouples high-frequency details and low-frequency trends using convolution and Transformer (global low-frequency modeler). However, the multi-layer convolution and deconvolution structures result in slow training and high memory usage. To address these issues, we propose a frequency-aligned knowledge distillation strategy, which extracts multi-scale spectral features from the teacher's latent space, including both high and low frequency components, to guide the lightweight student model in capturing both local fine-grained variations and global evolution patterns. Experimental results show that SDKD significantly improves performance, achieving reductions of up to 81.3% in MSE and in MAE 52.3% on the Navier-Stokes equation dataset. The framework effectively captures both high-frequency variations and long-term trends while reducing computational complexity. Our codes are available at https://github.com/itsnotacie/SDKD

知识蒸馏时空预测轻量化频域建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。