用迁移学习的扩散模型,显著降低粒子图像测速的噪声误差。
PIV-FlowDiffuser:Transfer-learning-based denoising diffusion models for PIV
- 先在计算机视觉数据上预训练,再用合成粒子图像微调。
- 在经典数据集上将平均端点误差降低59.4%。
- 适合处理真实粒子图像,提升泛化能力。
深度学习算法显著缩短了粒子图像测速(PIV)的计算时间并提升了空间分辨率。然而,基于合成数据训练的模型在实际粒子图像上因领域差异导致性能下降,常出现特殊残差模式。为逐步消除此类噪声,本文采用去噪扩散模型(FlowDiffuser)进行PIV分析,并通过迁移学习策略训练数据密集的迭代去噪模型,提出PIV-FlowDiffuser方法。具体包括:(1)在计算机视觉社区的多组光流数据集(如Sintel、KITTI)上预训练FlowDiffuser模型;(2)在合成PIV数据集上微调预训练模型。其中,PIV图像放大两倍以解析小尺度湍流结构。可视化结果表明,该方法有效抑制噪声模式。在经典Cai数据集上,相比RAFT256-PIV基线,平均端点误差(AEE)降低59.4%。此外,得益于迁移学习,PIV-FlowDiffuser在未见粒子图像上表现出更强泛化能力。研究强调了基于迁移学习的去噪扩散模型在PIV中的潜力,并推荐读者参考代码仓库 https://github.com/Zhu-Qianyu/PIV-FlowDiffuser 获取详细实现。
原文摘要 · Abstract (English)
Deep learning algorithms have significantly reduced the computational time and improved the spatial resolution of particle image velocimetry~(PIV). However, the models trained on synthetic datasets might have a degraded performance on practical particle images due to domain gaps. As a result, special residual patterns are often observed for the vector fields of deep learning-based estimators. To reduce the special noise step-by-step, we employ a denoising diffusion model~(FlowDiffuser) for PIV analysis. And the data-hungry iterative denoising diffusion model is trained via a transfer learning strategy, resulting in our PIV-FlowDiffuser method. Specifically, (1) pre-training a FlowDiffuser model with multiple optical flow datasets of the computer vision community, such as Sintel, KITTI, etc; (2) fine-tuning the pre-trained model on synthetic PIV datasets. Note that the PIV images are upsampled by a factor of two to resolve the small-scale turbulent flow structures. The visualized results indicate that our PIV-FlowDiffuser effectively suppresses the noise patterns. Therefore, the denoising diffusion model reduces the average end-point error~($AEE$) by 59.4% over RAFT256-PIV baseline on the classic Cai's dataset. Besides, PIV-FlowDiffuser exhibits enhanced generalization performance on unseen particle images due to transfer learning. Overall, this study highlights the transfer-learning-based denoising diffusion models for PIV. And a detailed implementation is recommended for interested readers in the repository https://github.com/Zhu-Qianyu/PIV-FlowDiffuser.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。