通过堆叠多波U-Net提升物理动态建模精度与效率
Deep Wave Network for Modeling Multi-Scale Physical Dynamics

- 用串联多层波结构扩展U-Net深度,跨波跳连实现多尺度渐进优化
- 在2D/3D流体基准上,相同算力下误差降低,训练时间最多减少3倍
- 适合需要高精度与低耗时平衡的科学计算场景
深度学习模型性能受架构容量影响显著,宽度与深度是主要调控因素。但在物理科学应用中,模型常在固定尺寸或分离准确率与计算成本下比较,这可能导致误导,因不同架构在宽深变化时表现出不同的准确率-成本权衡。该问题在广泛用于多尺度气体、流体与等离子体动力学建模的U-Net型编码器-解码器结构中尤为突出:其通过编码器逐步降低空间分辨率,再由解码器恢复并预测,跳连机制保留细粒度信息并改善优化。实践中通常仅调整宽度,而固定深度(固定下采样/上采样阶段数,每阶段少量卷积),限制了对深度系统性探索以优化准确率-成本关系。本文提出深度波网络(DW-Net),通过级联多个编码器-解码器“波”结构,并在波内与波间引入跳连,实现渐进式跨尺度精炼。所有模型保持相同训练数据、优化器与调度策略。不评估单一配置,而是训练各架构的多种宽度变体,对比准确率与GPU时间的帕累托前沿。在多个2D与3D流场基准测试中,DW-Net持续优于单波U-Net,实现相同成本下更高准确率,或相同准确率下更低成本,并在相同训练设置下达到低误差区域时训练时间最多减少3倍。
原文摘要 · Abstract (English)
Performance of deep learning models is strongly governed by architectural capacity, with width and depth as primary controls. However, in physical-science applications, models are often compared at a single fixed size or by separating accuracy and computational cost, which can be misleading since architectures exhibit different accuracy-cost scaling as width and depth vary. This issue is particularly relevant for U-Net-type encoder-decoder models, widely used for multi-scale gas, fluid, and plasma dynamics due to their ability to represent features across spatial scales. A U-Net constructs a multi-resolution representation via an encoder that progressively reduces spatial resolution, followed by a decoder that restores it for prediction. Skip connections link corresponding encoder and decoder features, preserving fine-scale information and improving optimization. In practice, U-Net width is routinely tuned, while depth is typically kept fixed (a set number of down/up-sampling stages with few convolutions per stage), limiting systematic exploration of depth for improving the accuracy-cost trade-off. We address this limitation by increasing effective depth through stacking multiple encoder-decoder "waves" in series, with skip connections both within and across waves to enable progressive cross-scale refinement. We call this architecture a Deep Wave Network (DW-Net). Training data, optimization, and schedules are kept identical across models. Instead of evaluating single configurations, we train multiple width variants of each architecture and compare accuracy vs. GPU time Pareto fronts. Across several 2D and 3D flow benchmarks, DW-Net models consistently improve the Pareto frontier over single-wave U-Nets, achieving higher accuracy at matched cost or similar accuracy at reduced cost, and reaching low-error regimes with up to 3x less training time under identical training settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。