用分层网格变分自编码器构建器官形状图谱,实现高精度可解释的三维形状建模。
Construction of an Organ Shape Atlas Using a Hierarchical Mesh Variational Autoencoder
- 采用分层潜在变量的网格变分自编码器,提升复杂器官形状的表示能力。
- 肝脏和胃的重建平均顶点距离分别达1.5毫米和1.4毫米,均值误差低于0.8毫米。
- 支持多尺度形状插值与特征解耦,适合医学影像分析与手术导航应用。
器官形状图谱通过少量参数表征活体中器官与骨骼的形状和位置,有望广泛应用于术中导航和放疗。由于软组织器官在个体间差异显著,线性模型难以重建具有大范围局部变化的形状;传统非线性模型则难以控制和解释生成结果。因此,深度学习在三维形状表示中备受关注。本文提出一种基于分层潜在变量的网格变分自编码器(MeshVAE)的器官形状图谱方法。通过层级化潜在变量设计,既保持了复杂生物器官形状及个体间非线性差异的建模性能,又实现了低维潜在空间下的形状表达。此外,定义不同分辨率下顶点对应关系的模板,支持网格数据的层次化表示,并可分别调控器官形状的全局与局部特征。模型在124例肝脏和胃部器官网格数据上训练,测试集(19例)中,肝脏形状重建的平均顶点距离为1.5毫米,均值距离为0.7毫米;胃部形状平均距离为1.4毫米,均值距离为0.8毫米。所提方法能连续生成插值形状,通过在不同层级调节潜在变量,实现了相比PCA更优的形状特征层次分离。
原文摘要 · Abstract (English)
An organ shape atlas, which represents the shape and position of the organs and skeleton of a living body using a small number of parameters, is expected to have a wide range of clinical applications, including intraoperative guidance and radiotherapy. Because the shape and position of soft organs vary greatly among patients, it is difficult for linear models to reconstruct shapes that have large local variations. Because it is difficult for conventional nonlinear models to control and interpret the organ shapes obtained, deep learning has been attracting attention in three-dimensional shape representation. In this study, we propose an organ shape atlas based on a mesh variational autoencoder (MeshVAE) with hierarchical latent variables. To represent the complex shapes of biological organs and nonlinear shape differences between individuals, the proposed method maintains the performance of organ shape reconstruction by hierarchizing latent variables and enables shape representation using lower-dimensional latent variables. Additionally, templates that define vertex correspondence between different resolutions enable hierarchical representation in mesh data and control the global and local features of the organ shape. We trained the model using liver and stomach organ meshes obtained from 124 cases and confirmed that the model reconstructed the position and shape with an average distance between vertices of 1.5 mm and mean distance of 0.7 mm for the liver shape, and an average distance between vertices of 1.4 mm and mean distance of 0.8 mm for the stomach shape on test data from 19 of cases. The proposed method continuously represented interpolated shapes, and by changing latent variables at different hierarchical levels, the proposed method hierarchically separated shape features compared with PCA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。