用图注意力增强球谐卷积,提升脑皮层表面配准精度与效率
GESH-Net: Graph-Enhanced Spherical Harmonic Convolutional Networks for Cortical Surface Registration
- 基于多尺度级联结构和球谐卷积,实现无需监督的配准
- 引入图注意力模块,显著提升全局特征学习能力
- 适用于高精度脑影像分析,适合医学图像研究者
当前基于经典方法的脑皮层表面配准技术已较为成熟,但其需在形变空间中通过优化算法逐对搜索最优变换,难以满足医学图像配准对实时性和高精度的要求。基于深度学习的配准方法成为新方向,但相关研究仍较少。尽管深度学习理论上具备更强表征能力,但在注册精度和形变控制上超越先进经典方法仍具挑战。为此,本文构建一种深度学习模型以解决该问题:(1)设计了一种无监督的多尺度级联结构配准网络,并引入基于球谐变换的卷积方法,解决了球面特征变换的尺度刚性问题,优化了多尺度配准流程;(2)通过集成注意力机制,引入图增强模块,利用图注意力网络帮助网络学习脑皮层数据的全局特征,显著提升了网络的特征提取能力。实验结果表明,该模块有效增强了网络对全局结构的捕捉能力,配准效果优于现有方法。
原文摘要 · Abstract (English)
Currently, cortical surface registration techniques based on classical methods have been well developed. However, a key issue with classical methods is that for each pair of images to be registered, it is necessary to search for the optimal transformation in the deformation space according to a specific optimization algorithm until the similarity measure function converges, which cannot meet the requirements of real-time and high-precision in medical image registration. Researching cortical surface registration based on deep learning models has become a new direction. But so far, there are still only a few studies on cortical surface image registration based on deep learning. Moreover, although deep learning methods theoretically have stronger representation capabilities, surpassing the most advanced classical methods in registration accuracy and distortion control remains a challenge. Therefore, to address this challenge, this paper constructs a deep learning model to study the technology of cortical surface image registration. The specific work is as follows: (1) An unsupervised cortical surface registration network based on a multi-scale cascaded structure is designed, and a convolution method based on spherical harmonic transformation is introduced to register cortical surface data. This solves the problem of scale-inflexibility of spherical feature transformation and optimizes the multi-scale registration process. (2)By integrating the attention mechanism, a graph-enhenced module is introduced into the registration network, using the graph attention module to help the network learn global features of cortical surface data, enhancing the learning ability of the network. The results show that the graph attention module effectively enhances the network's ability to extract global features, and its registration results have significant advantages over other methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。