用树状结构生成模型,16倍提升岩石3D显微CT分辨率。
Memory-Efficient Super-Resolution of 3D Micro-CT Images Using Octree-Based GANs: Enhancing Resolution and Segmentation Accuracy
- 基于八叉树的生成对抗网络,降低3D图像超分辨内存占用。
- 分辨率从7微米/体素提升至0.44微米/体素,实现16倍放大。
- 适合地质成像、岩心分析等需要高精度3D重建的研究者。
我们提出一种内存高效的算法,利用生成模型显著提升岩石3D微计算机断层扫描(micro-CT)图像的质量。该模型实现16倍分辨率提升,并修正了因不同矿物间X射线衰减重叠导致的分割误差。采用的是基于八叉树的3D卷积Wasserstein生成对抗网络(Octree-based 3D Convolutional WGAN-GP),通过在3D渐进生成器中引入八叉树结构,实现内存高效的3D八叉树卷积层。该方法克服了体数据深度学习中的长期内存瓶颈,使16倍3D超分辨成为可能,而常规方法受限于立方级内存增长难以实现。训练使用低分辨率3D micro-CT图像与未配对的2D高分辨率激光扫描显微镜图像。训练后,分辨率从7微米/体素提升至0.44微米/体素,矿物分割准确。在Berea砂岩上验证,显著改善孔隙表征与矿物区分能力,为现代地球科学成像中的主要计算限制提供可靠解决方案。
原文摘要 · Abstract (English)
We present a memory-efficient algorithm for significantly enhancing the quality of segmented 3D micro-Computed Tomography (micro-CT) images of rocks using a generative model. The proposed model achieves a 16x increase in resolution and corrects inaccuracies in segmentation caused by the overlapping X-ray attenuation in micro-CT measurements across different minerals. The generative model employed is a 3D Octree-based convolutional Wasserstein generative adversarial network with gradient penalty. To address the challenge of high memory consumption inherent in standard 3D convolutional layers, we implemented an Octree structure within the 3D progressive growing generator model. This enabled the use of memory-efficient 3D Octree-based convolutional layers. The approach is pivotal in overcoming the long-standing memory bottleneck in volumetric deep learning, making it possible to reach 16x super-resolution in 3D, a scale that is challenging to attain due to cubic memory scaling. For training, we utilized segmented 3D low-resolution micro-CT images along with unpaired segmented complementary 2D high-resolution laser scanning microscope images. Post-training, resolution improved from 7 to 0.44 micro-m/voxel with accurate segmentation of constituent minerals. Validated on Berea sandstone, this framework demonstrates substantial improvements in pore characterization and mineral differentiation, offering a robust solution to one of the primary computational limitations in modern geoscientific imaging.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。