arXiv:2607.11998eess.IVcs.AI2026-07

用单目视频和高性能计算,无传感器同时估算五种海浪参数。

HPC-Enabled Video-based Coastal Wave Parameter Estimation Using V-JEPA and Deep Spatiotemporal Learning

论文配图:HPC-Enabled Video-based Coastal Wave Parameter Estimation Using V-JEPA and Deep Spatiotemporal Learning
图 1 · 摘自论文原文
  • 基于自监督ViT和双流时序编码,提取复杂场景下的波浪时空特征。
  • 在仅6个标注场景下,波向相关性达0.832,验证了可行性。
  • 适合海洋监测、气象预报等需低成本海浪参数的领域。

传统现场测量方法存在部署成本高、空间覆盖差、易受风暴影响等问题。本文提出一种基于视频与高性能计算(HPC)的深度学习框架,仅通过单目海岸视频即可无传感器联合估计五种海岸波浪参数:显著波高(Hs)、最大波高(Hmax)、峰值周期(Tp)、零交叉周期(Tz)和波向(theta)。模型采用V-JEPA(自监督)ViT Small骨干网络实现视觉挑战场景下的鲁棒时空特征提取,双流SlowFast时序编码器捕捉水动力破碎与涌浪两种状态下的波浪运动宽带表征,基于Farneback光流算法的光流分支强化对水动力活跃波长带的敏感性,多任务回归层引入Airy波色散约束(lambda_p = 0.1)。模型在NVIDIA DGX A100集群上训练,早停于第31轮,各项参数皮尔逊相关系数分别为:Hs: 0.451,Hmax: 0.578,Tp: 0.643,Tz: 0.680,波向: 0.832,且在地理多样性的保留测试数据上具备泛化能力。尽管处于数据有限(6个标注训练场景)状态,仍表现出统计显著的时间相关性(PCC 0.451~0.832),R²最高为0.246,表明随着更大标注数据集的加入,方差解释能力将提升。

原文摘要 · Abstract (English)

High deployment cost, poor spatial coverage and susceptibility to storm conditions are all challenges faced by traditional in-situ methods. This paper presents a video-based and high performance computing (HPC) enabled deep learning framework for joint sensor free estimation of five coastal wave parameters, namely significant wave height (Hs), maximum wave height (Hmax), peak period (Tp), zero upcrossing period (Tz) and wave direction (theta) from monocular coastal video. The proposed architecture comprises of a V-JEPA (self supervised) ViT Small backbone for robust spatiotemporal feature extraction in visually challenging scenarios, a dual-stream SlowFast temporal encoder for broad bandwidth representation of wave motion in both hydrodynamic breaking and swell regimes, an optical flow stream based on Farneback optical flow algorithm for adding saliency information to the structure with emphasis on hydrodynamically active wavelength bands of waves, and a multi-task regression layer with dispersion constraints (Airy wave dispersion lambda_p = 0.1). The model was trained on an NVIDIA DGX A100 cluster and was early stopped at epoch 31 and achieved Pearson correlation coefficients of 0.451, 0.578, 0.643, 0.680 and 0.832 for Hs, Hmax, Tp, Tz and wave direction respectively, with generalization ability to geographically diverse held out test data sites. While operating in a data-limited regime (6 annotated training scenes), the framework demonstrates statistically significant temporal correlations (PCC of 0.451 to 0.832), confirming proof of concept feasibility; R2 values (max 0.246) indicate that variance capture will improve with larger annotated datasets.

视频估计波浪参数深度学习高性能计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。