arXiv:2608.07681cs.LGphysics.data-an2026-08

用物理规律引导注意力,提升工业与天体时间序列预测的准确性与稳定性。

PhysAttNet: Enhancing Predictive Performance in Industrial and Astrophysical Time Series via Physics-Informed Attention

论文配图:PhysAttNet: Enhancing Predictive Performance in Industrial and Astrophysical Time Series via Physics-Informed Attention
图 1 · 摘自论文原文
  • 通过物理启发的正则化约束,让注意力聚焦于平滑、峰值中心的时序结构。
  • 在铣削力与耀斑预测任务中,准确率和关键事件捕捉能力显著提升。
  • 无需标注即可融入物理先验,适合需要可解释性的工业与天文场景。

精确且稳健的时间序列预测在制造监测与天体事件探测等物理过程应用中至关重要。模型需在噪声、波动和测量不确定性下保持可靠性,同时捕捉对应物理事件的局部时序结构。卷积神经网络(CNN)因计算高效和强表征能力被广泛应用,但其学习到的时序注意力常不稳定或违背物理规律,影响鲁棒性、泛化性和可解释性。本文提出PhysAttNet,一种面向时间序列预测的物理信息注意力框架。该框架在轻量级CNN基础上引入由领域知识驱动的注意力头,训练中施加三项互补约束:对齐正则化(鼓励注意力跟随输入信号导出的平滑、峰值中心结构)、平滑正则化(强制时序演化连续)与稀疏正则化(促进对关键区间的聚焦)。这些可微分正则项引入物理引导的归纳偏置,无需标注或人工监督。在铣削力预测与耀斑时间序列预测两个任务上的实验表明,PhysAttNet显著提升了预测精度、泛化能力及对结构性关键事件的捕捉表现。

原文摘要 · Abstract (English)

Accurate and robust time series forecasting is essential in many applications involving physical processes, such as manufacturing monitoring and astrophysical event detection. In these settings, predictive models must remain reliable under noise, variability, and measurement uncertainty while capturing temporally localized structures corresponding to physically meaningful events. Convolutional neural networks (CNNs) are widely used for such tasks due to their computational efficiency and strong representational capacity. However, their learned temporal representations often exhibit unstable or physically inconsistent attention patterns, reducing robustness, generalization, and interpretability. This paper introduces PhysAttNet, a physics-informed attention framework for time series forecasting. PhysAttNet augments a lightweight CNN forecaster with an attention head guided by domain-informed regularization reflecting the structural properties of physical signals. Specifically, three complementary constraints are imposed during training: an alignment regularization that encourages attention to follow smooth, peak-centered temporal structures derived from the input signal, a smoothness regularization that enforces continuous temporal evolution, and a sparsity regularization that promotes selective focus on informative intervals. These differentiable regularization terms introduce physics-guided inductive bias without requiring annotated explanations or manual supervision. Experiments on two distinct applications, namely predicting cutting forces during milling and forecasting flares in blazar time series, demonstrate that PhysAttNet improves forecasting accuracy, generalization, and prediction performance on structurally important events.

时间序列注意力机制物理信息预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。