arXiv:2604.17389cs.CV2026-04

用点云实现术中脑移位补偿,无需打断手术流程

Deep learning based Non-Rigid Volume-to-Surface Registration for Brain Shift compensation Using Point Cloud

论文配图:Deep learning based Non-Rigid Volume-to-Surface Registration for Brain Shift compensation Using Point Cloud
图 1 · 摘自论文原文
  • 通过深度学习从稀疏点云估计全脑形变场
  • 在部分表面观测下达到1.13±0.75mm的端点误差
  • 适合嵌入手术流程的实时脑移位校正,适用于微创手术

软组织形变是图像引导神经外科中的主要挑战,术中大脑因脑移位与术前影像出现显著偏差,影响导航精度和手术安全。现有方法多依赖术中MRI、CT或超声,操作繁琐且难以重复集成。相比之下,立体显微镜或激光扫描仪可重建部分皮层点云,仅覆盖暴露区域,不干扰手术进程;但此类局部且噪声大的观测使形变估计极具挑战。本研究提出一种基于深度学习的非刚性体-面配准框架,仅凭稀疏术中表面观测即可实现密集位移场估计,无需显式点对应或体数据。网络结合多尺度点特征提取与分层形变解码器,捕捉全局与局部形变。核心创新在于将部分术中表面信息融合至完整术前点云域,实现隐式对应学习与密集形变恢复。定量结果表明,在复杂局部观测条件下仍能准确还原细微形变,端点误差(EPE)达1.13±0.75 mm,均方根误差(RMSE)为1.33±0.81 mm。该方法支持自动、兼容手术流程的脑移位补偿。

原文摘要 · Abstract (English)

Soft-tissue deformation remains a major limitation in image-guided neurosurgery, where intra-operative anatomy can deviate substantially from pre-operative imaging due to brain shift, compromising navigation accuracy and surgical safety. Existing compensation methods often rely on intra-operative MRI, CT, or ultrasound, which are disruptive and difficult to integrate repeatedly into the surgical workflow. In contrast, partial 3D cortical surfaces can be reconstructed as point clouds from stereoscopic microscopes or laser range scanners (LRS), capturing only a limited portion of the exposed cortex. This makes point cloud registration a practical alternative without interrupting surgery; however, such partial and noisy observations make deformation estimation highly challenging. In this study, we propose a deep learning-based framework for non-rigid volume-to-surface registration, enabling dense displacement field estimation from sparse intra-operative surface observations without explicit point correspondences or volumetric intra-operative imaging. The network leverages multi-scale point-based feature extraction and a hierarchical deformation decoder to capture both global and local deformations. The key contribution lies in integrating partial intra-operative surface information into the full pre-operative point cloud domain, enabling implicit correspondence learning and dense deformation recovery under limited visibility. Quantitative results demonstrate accurate recovery of fine-scale deformations, achieving an Endpoint Error (EPE) of 1.13 +/- 0.75 mm and RMSE of 1.33 +/- 0.81 mm under challenging partial-surface conditions. The proposed approach supports automatic, workflow-compatible brain-shift compensation from sparse surface observations.

脑移位点云配准深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。