用状态空间模型实现医学点云分层特征学习,提升疾病诊断精度
Hierarchical Feature Learning for Medical Point Clouds via State Space Model
- 分层采样+KNN聚合多尺度结构信息
- 在MedPointS数据集上三任务均超越现有方法
- 适合医学影像分析与点云建模研究者
基于深度学习的点云建模已成为通用形状分析的重要组成部分。近年来,Transformer和状态空间模型(SSM)在点云学习中展现出巨大潜力。然而,针对具有重大疾病诊断与治疗价值的医学点云,相关研究仍较有限。本文提出一种基于SSM的医学点云分层特征学习框架。具体地,通过最远点采样将输入下采样为多级结构,在每一层级进行k近邻(KNN)查询以聚合多尺度结构信息。为提升SSM处理不规则点云的效率,引入坐标顺序与由内向外扫描策略实现高效序列化。点特征通过普通和分组点SSM模块,分别从短邻域序列与长点序列中逐步提取,以捕捉局部模式与长程依赖。为验证方法有效性,构建大规模医学点云数据集MedPointS,用于解剖分类、补全与分割任务。在MedPointS上的大量实验表明,所提方法在所有任务中均表现优异。数据集地址:https://flemme-docs.readthedocs.io/en/latest/medpoints.html。代码已集成至公开医学影像平台:https://github.com/wlsdzyzl/flemme。
原文摘要 · Abstract (English)
Deep learning-based point cloud modeling has been widely investigated as an indispensable component of general shape analysis. Recently, transformer and state space model (SSM) have shown promising capacities in point cloud learning. However, limited research has been conducted on medical point clouds, which have great potential in disease diagnosis and treatment. This paper presents an SSM-based hierarchical feature learning framework for medical point cloud understanding. Specifically, we down-sample input into multiple levels through the farthest point sampling. At each level, we perform a series of k-nearest neighbor (KNN) queries to aggregate multi-scale structural information. To assist SSM in processing point clouds, we introduce coordinate-order and inside-out scanning strategies for efficient serialization of irregular points. Point features are calculated progressively from short neighbor sequences and long point sequences through vanilla and group Point SSM blocks, to capture both local patterns and long-range dependencies. To evaluate the proposed method, we build a large-scale medical point cloud dataset named MedPointS for anatomy classification, completion, and segmentation. Extensive experiments conducted on MedPointS demonstrate that our method achieves superior performance across all tasks. The dataset is available at https://flemme-docs.readthedocs.io/en/latest/medpoints.html. Code is merged to a public medical imaging platform: https://github.com/wlsdzyzl/flemme.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。