用生成模型将低分辨率监控图转为高分辨率,实现低成本3D打印过程监测。
Deep Learning based Optical Image Super-Resolution via Generative Diffusion Models for Layerwise in-situ LPBF Monitoring
- 基于条件扩散模型,从低分辨率摄像头图像生成高分辨率熔融层图像。
- 重建图像在PSNR、SSIM等指标上表现优异,保留了高频细节和表面粗糙度特征。
- 可零样本迁移至不同零件结构,适合工业级增材制造实时监控场景。
激光粉末床熔融(L-PBF)过程中缺陷的随机形成影响其在高精度应用中的推广。光学监控可通过逐层成像识别缺陷,但受限于成本与内存,难以扩展至高分辨率。为此,本文采用生成式深度学习模型,将低成本、低分辨率的构建板图像映射为详细的高分辨率光学图像,实现高性价比的过程监控。具体地,训练了一个条件隐变量概率扩散模型,从低分辨率网络摄像头图像生成逼真的高分辨率构建板图像,恢复微尺度特征与表面粗糙度分布。我们通过峰值信噪比(PSNR)、结构相似性指数(SSIM)及小波协方差等指标评估生成图像的重建质量,验证其对高频信息的保持能力。此外,基于Segment Anything基础模型设计框架,重建打印件的三维形貌并分析重构样本的表面粗糙度。最后,通过合成低分辨率数据探索该框架在其他零件几何下的零样本泛化能力。
原文摘要 · Abstract (English)
The stochastic formation of defects during Laser Powder Bed Fusion (L-PBF) negatively impacts its adoption for high-precision use cases. Optical monitoring techniques can be used to identify defects based on layer-wise imaging, but these methods are difficult to scale to high resolutions due to cost and memory constraints. Therefore, we implement generative deep learning models to link low-cost, low-resolution images of the build plate to detailed high-resolution optical images of the build plate, enabling cost-efficient process monitoring. To do so, a conditional latent probabilistic diffusion model is trained to produce realistic high-resolution images of the build plate from low-resolution webcam images, recovering the distribution of small-scale features and surface roughness. We first evaluate the performance of the model by analyzing the reconstruction quality of the generated images using peak-signal-to-noise-ratio (PSNR), structural similarity index measure (SSIM) and wavelet covariance metrics that describe the preservation of high-frequency information. Additionally, we design a framework based upon the Segment Anything foundation model to recreate the 3D morphology of the printed part and analyze the surface roughness of the reconstructed samples. Finally, we explore the zero-shot generalization capabilities of the implemented framework to other part geometries by creating synthetic low-resolution data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。