arXiv:2606.13302cs.AIcs.LG2026-06

用视频直接估算海浪周期,结合物理规律提升准确性与可解释性。

Physics-Guided Spatiotemporal Learning for Coastal Wave Peak Period Estimation from Video

论文配图:Physics-Guided Spatiotemporal Learning for Coastal Wave Peak Period Estimation from Video
图 1 · 摘自论文原文
  • 通过时序像素方差自动定位感兴趣区域,结合仿真到真实的数据迁移学习。
  • LtViViT精度最高,TinyWaveNet在时间稳定性与海洋学意义上表现更好。
  • 物理约束正则化使预测更符合实际趋势,适合数据稀缺的海岸监测场景。

从原始视频中直接估计具有物理可解释性的周期信号是一个时空耦合的学习难题,尤其在标签稀疏、缺乏物理依据和标准化基准的情况下。海岸波浪监测即为一例:当前基于视频的深度学习方法在估计波浪参数时存在物理可解释性差的问题,且需中间数据处理。本文提出仅以视频为输入的波浪峰周期估计框架,包含三个部分:基于时序像素方差的自动感兴趣区域检测、多阶段仿真到真实迁移学习流程,以及输出预测的物理引导正则化。在合成预训练、银标签适应和专家微调阶段,对比了多种时空架构(如Transformer和递归卷积网络)。结果表明,LtViViT在估计精度上最优,而TinyWaveNet在时间稳定性和海洋学技能方面更优。消融实验显示,物理引导正则化有助于更一致地跟随趋势并避免物理上无意义的预测。此外,基于Grad-CAM的可解释性分析表明,物理引导的TinyWaveNet的空间关注区域与水动力活跃的近岸区一致。总体支持基于视频的物理引导深度学习作为长期海岸波浪监测的低成本、可操作方案,并提供了一种在数据稀缺条件下进行物理约束时空回归的可迁移策略。

原文摘要 · Abstract (English)

Direct estimation of physically interpretable periodic signals from raw video constitutes a spatiotemporally grounded learning problem that proves to be difficult especially when facing label sparsity, lack of physical grounding and standardization benchmarks. The wave monitoring at coastal sites is one such real-world example where current deep learning approaches for estimating wave parameters using video as input suffer from physical interpretability and require some kind of intermediate data processing. In this study we propose a framework for wave peak period estimation using only video as input through three components: automated region-of-interest detection using temporal pixel variance, multi-stage Sim-to-Real transfer learning process, and physics-guided regularization of the output predictions. Various spatiotemporal architectures, including Transformer and recurrent-convolutional were compared during the stages of synthetic pretraining, silver label adaptation, and expert fine-tuning. It has been found out that LtViViT achieves the highest accuracy in its estimates, while TinyWaveNet shows superior temporal stability and oceanographic skill. Additionally, ablation studies have demonstrated that physics-guided regularization helps to follow the trends in predictions more consistently and prevent physically meaningless predictions. Moreover, Grad-CAM-based explainability analysis of the physics-guided TinyWaveNet showed that its spatial focus aligns with hydrodynamically active surf-zone regions. Overall, the findings support physics-guided, video-based deep learning as a cost-effective and operationally viable approach for long-term coastal wave monitoring, and demonstrate a transferable strategy for physically-constrained spatiotemporal regression from video under data-scarce conditions.

视频分析波浪预测物理引导时空建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。