用科学机器学习模型降低真实流体建模的数据需求,提升预测精度。
Data-Efficient Inference of Neural Fluid Fields via SciML Foundation Model
- 利用预训练的科学机器学习模型提取流体特征,指导神经流场建模。
- 仅需25%-50%的训练帧,未来预测的峰值信噪比提升9%-36%。
- 适合需要少样本、高精度流体重建的研究者和工业应用。
三维视觉的进展推动了神经流体场建模与真实流体渲染的发展,但现有方法依赖密集的真实流场采集,需专用实验室设备,成本高昂。科学机器学习(SciML)基础模型在大量偏微分方程(PDE)仿真数据上预训练,蕴含丰富的多物理场知识,可作为流体场推理的领域先验。然而其在真实视觉任务中的迁移能力仍不明确。本文证明,SciML基础模型能显著降低真实3D流体动力学建模的数据需求并提升泛化性能。我们的方法借助基础模型强大的预测能力和有意义的表征,提出一种协同训练策略,将基础模型提取的增强帧与流体特征注入神经流场。大量实验表明,相比先前方法,本方法在定量指标和视觉质量上均有显著提升。尤其在未来的预测中,峰值信噪比(PSNR)提升9%-36%,同时训练帧数量减少25%-50%。这些结果凸显了SciML基础模型在真实流体重建中的实际应用价值。代码已开源:https://github.com/delta-lab-ai/SciML-HY。
原文摘要 · Abstract (English)
Recent developments in 3D vision have enabled significant progress in inferring neural fluid fields and realistic rendering of fluid dynamics. However, these methods require dense captures of real-world flows, which demand specialized laboratory setups, making the process costly and challenging. Scientific machine learning (SciML) foundation models, pretrained on extensive simulations of partial differential equations (PDEs), encode rich multiphysics knowledge and thus provide promising sources of domain priors for fluid field inference. Nevertheless, the transferability of these foundation models to real-world vision problems remains largely underexplored. In this work, we demonstrate that SciML foundation models can significantly reduce the data requirements for inferring real-world 3D fluid dynamics while improving generalization. Our method leverages the strong forecasting capabilities and meaningful representations learned by SciML foundation models. We introduce a novel collaborative training strategy that equips neural fluid fields with augmented frames and fluid features extracted from the foundation model. Extensive experiments show substantial improvements in both quantitative metrics and visual quality over prior approaches. In particular, our method achieves a 9-36% improvement in peak signal-to-noise ratio (PSNR) for future prediction while reducing the number of required training frames by 25-50%. These results highlight the practical applicability of SciML foundation models for real-world fluid dynamics reconstruction. Our code is available at: https://github.com/delta-lab-ai/SciML-HY.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。