构建可控混沌系统的基准测试,评估图神经网络在复杂动态中的表现。
ChaosNetBench: Benchmarking Spatio-Temporal Graph Neural Networks on Chaotic Lattice Dynamics

- 用耦合标准映射构造可调混沌的合成数据集,支持多维度实验。
- 13种模型对比显示:低混沌时非图模型更优,高混沌下图模型更稳定。
- 适合研究时空图网络在物理系统预测中的鲁棒性与适用边界。
时空图神经网络(STGNNs)广泛应用于交通、天气等动态物理系统的短期预测。然而,当前评估普遍依赖单一领域的真实数据集和固定划分,难以跨不同动力学状态比较模型性能。本文提出ChaosNetBench(CNB),一个基于耦合标准映射的合成基准数据集与评估框架,可在受控条件下研究STGNN在多维混沌动态下的表现。该框架通过独立调节局部混沌度(K)、耦合强度(ε)和系统规模(N),构建了96个系统实例和9,600条轨迹,具备已知拓扑与动力学特性。我们引入混沌指标、评估指标及分析协议,用于系统评估不同STGNN架构对局部与全局混沌的适应能力。通过分析13种模型(5种STGNNs和8种非图基线,如TCN、N-BEATS、iTransformer),结果表明:在局部混沌较低时,非图基线仍具竞争力;而在更高混沌水平下,STGNNs(如Graph WaveNet、D2STGNN、STAEformer)表现出更强的鲁棒性。CNB为系统比较和分析STGNN处理不同混沌水平的能力提供了可复现的测试平台。
原文摘要 · Abstract (English)
Spatio-temporal graph neural networks (STGNNs) are widely used for short-term forecasting in dynamic physical systems such as traffic and weather. However, the prevailing evaluation practice uses real world benchmark data sets in a single domain with a single fixed holdout splits, making it difficult to compare architectures across different dynamical regimes. We introduce ChaosNetBench (CNB), a synthetic benchmark dataset and evaluation framework for studying STGNN performance under controlled multidimensional chaotic dynamics. CNB is built on a lattice of coupled standard maps with independently tunable local chaos ($K$), coupling strength ($\varepsilon$), and system size ($N$), providing known topology and known dynamics across 96 system instances and 9{,}600 trajectories. We introduce chaos indicators, evaluation metrics and a protocol to analyze and compare the capacity of STGNN architectures to deal with different levels of local and global chaos. We illustrate the usage of the framework by analyzing 13 architectures (5 STGNNs and 8 non-graph baselines). The results reveal a regime dependent transition in which non-graph baselines (TCN, N-BEATS, iTransformer) remain competitive when there is low local chaos, while STGNNs (e.g., Graph WaveNet, D2STGNN, STAEformer) are generally more resilient to higher levels of local and global chaos. CNB provides a practical, reusable testbed for systematically comparing and analyzing the capacity of STGNN architectures to handle different levels of local and global chaos.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。