arXiv:2607.21840cs.CVeess.IV2026-07

用2D转换+混合网络,精准预测脑褶皱生长形态

Toward High-Fidelity 3D Point-Cloud Learning for Brain Folding Morphology Prediction Using Trans-Unet

论文配图:Toward High-Fidelity 3D Point-Cloud Learning for Brain Folding Morphology Prediction Using Trans-Unet
图 1 · 摘自论文原文
  • 将3D点云转为2D网格,结合卷积与自注意力机制
  • 在40,401个表面点上实现高保真折叠模式预测
  • 适合脑发育研究与医学影像建模领域

在三维空间中学习高保真点云特征面临排列不变性、局部上下文缺失、细粒度表面重建困难及高计算成本等挑战。本文提出Trans-Unet框架,先将3D点云数据转化为2D网格域,再采用融合卷积神经网络与自注意力机制的U型混合模型。该方法基于预设有限元脑片生长模型生成的高分辨率3D点云(表面40,401点,纤维2,382点),有效学习并重建精确特征,实现脑褶皱形态的准确预测。通过多技术融合,Trans-Unet在保留细粒度结构信息的同时显著降低计算开销与维度灾难;卷积模块捕捉层次化低层局部表征,自注意力机制建模全局高层语义与长程依赖。实验表明,该模型从初始状态(状态0或0-2)到最终状态(状态3)的脑片生长预测,在保真度与精度上均优于现有方法。

原文摘要 · Abstract (English)

Learning high-fidelity point-cloud features in the 3D space poses significant challenges, including permutation invariance, lack of local context, difficulty in fine-grained surface reconstruction, and high computational cost. In this article, we propose Trans-Unet, a novel framework that addresses these issues by first tansforming 3D point-cloud data into a 2D grid domain and then employing a U-shaped hybrid model that integrates Convolutional Neural Networks, and self-attention mechanisms. The proposed Trans-Unet effectively learns and reconstructs precise features from high-resolution 3D point-cloud data (with 40,401 points in surface and 2,382 points in fiber) derived from a predefined finite element brain patch growth model, enabling accurate prediction of brain folding patterns. By combining multiple techniques, Trans-Unet leverages the complementary strengths: the 3D-to-2D transformation preserves fine-grained structural information while significantly reducing computational cost and the curse of dimensionality; convolutional blocks capture hierarchical, low-level local representations; and the self-attention mechanism models global, high-level semantics and long-range dependencies. The dataset consists of 3D point-clouds containing both brain surface patches and fiber information generated by a large-scale finite element model. Trans-Unet is applied to predict brain surface folding from the initial state (state 0 or states 0-2) to the final state (state 3). Experimental results demonstrate that Trans-Unet achieves high-resolution predictions of brain patch growth, surpassing existing methods in both fidelity and accuracy.

3D点云脑发育深度学习形态预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。