提出PointVoxelFormer,用点云实现更高效精准的3D医学影像分析。
PointVoxelFormer -- Reviving point cloud networks for 3D medical imaging
- 融合点操作与可微栅格化,提升几何特征学习效率。
- 相比现有模型,速度提升3倍,内存减少5倍,配准误差降低超30%。
- 适合追求轻量化与高精度的医学影像研究者使用。
点云是医学影像中表示体数据的高效方式,不占用空区域资源,避免体素卷积网络在分辨率与视场间的权衡,从而实现更小、更鲁棒的模型。同时,点云提供对解剖表面和形状的模态无关表示,有助于弥合通用几何模型的领域差异,并去除患者特异性信息,增强数据共享时的隐私保护。尽管有诸多优势,点云在医学影像中仍远未被充分探索,相较体素3D CNN与视觉变换器,相关数据集及系统性比较研究仍缺失。点云中邻近点间的交互(如通过k近邻图进行边卷积或点变换)对学习几何有意义特征至关重要,但可能导致计算瓶颈。本文提出一种混合方法,结合点操作与中间可微栅格化及局部密集卷积网络。针对可变形点云配准,设计了一种坐标特征早期融合方案,将两组点云合并至统一参考系,并采用逆向一致的两步对齐架构。在三个不同数据集上的分割与配准任务中,该方法——PointVoxelFormer——实现了极紧凑模型,相较边卷积及其他前沿几何深度学习模型,获得三倍加速、五倍内存缩减以及超过30%的配准误差降低。
原文摘要 · Abstract (English)
Point clouds are a very efficient way to represent volumetric data in medical imaging. First, they do not occupy resources for empty spaces and therefore can avoid trade-offs between resolution and field-of-view for voxel-based 3D convolutional networks (CNNs) - leading to smaller and robust models. Second, they provide a modality agnostic representation of anatomical surfaces and shapes to avoid domain gaps for generic geometric models. Third, they remove identifiable patient-specific information and may increase privacy preservation when publicly sharing data. Despite their benefits, point clouds are still underexplored in medical imaging compared to volumetric 3D CNNs and vision transformers. To date both datasets and stringent studies on comparative strengths and weaknesses of methodological choices are missing. Interactions and information exchange of spatially close points - e.g. through k-nearest neighbour graphs in edge convolutions or point transformations - within points clouds are crucial for learning geometrically meaningful features but may incur computational bottlenecks. This work presents a hybrid approach that combines point-wise operations with intermediate differentiable rasterisation and dense localised CNNs. For deformable point cloud registration, we devise an early fusion scheme for coordinate features that joins both clouds within a common reference frame and is coupled with an inverse consistent, two-step alignment architecture. Our extensive experiments on three different datasets for segmentation and registration demonstrate that our method, PointVoxelFormer, enables very compact models that excel with threefold speed-ups, fivefold memory reduction and over 30% registration error reduction against edge convolutions and other state-of-the-art models in geometric deep learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。