arXiv:2606.14534cs.CV2026-06

用普通相机和单次高光谱扫描,快速生成乳腺保乳术标本的精准3D高光谱图

A Lightweight Fiducial-Based Pipeline for 3D Hyperspectral Mapping of ex-vivo Lumpectomy Specimens

论文配图:A Lightweight Fiducial-Based Pipeline for 3D Hyperspectral Mapping of ex-vivo Lumpectomy Specimens
图 1 · 摘自论文原文
  • 通过深度学习SfM+自定义束调整,用四个ArUco标记实现无标定3D几何重建
  • 3D配准误差低于1毫米,2D重投影误差低于0.02毫米,每例处理不到4分钟
  • 适合需术中精确定位可疑区域的乳腺保乳手术高光谱成像应用

高光谱成像(HSI)在保留乳房的乳腺癌手术中用于术中切除边缘评估具有潜力,但其临床应用需将固有的二维光谱信息映射到切除组织的三维形状上,以便精确定位可疑区域并进行靶向随访。我们提出一种完全自动化、无需标定的流水线,仅需一组消费级相机的RGB图像和一次正上方的HSI采集,即可生成离体乳腺肿块的3D高光谱点云。三维几何通过基于深度学习的运动结构(SfM)框架重建,并利用定制的束调整算法,在度量参考系中通过四个围绕标本放置的ArUco标记角点的一致性进行稳定。随后,无需恢复HSI相机姿态,即可将HSI立方体注册到重建结果:两个模态中可见的标记定义了16个角点对应关系,驱动平面单应性变换,并通过正交渲染的深度图查表恢复3D坐标。在两个离体乳腺肿块样本上评估,该流水线实现了低于1毫米的中位数3D配准误差和低于0.02毫米的2D重投影误差,单个标本处理时间在加速硬件上低于4分钟。这些结果支持将HSI引导的空间定位集成到乳腺保乳手术的术中边缘评估流程中。

原文摘要 · Abstract (English)

Hyperspectral Imaging (HSI) is a promising modality for intraoperative assessment of resection margins in Breast-Conserving Surgery (BCS), but its clinical translation requires aligning the inherently 2D spectral information onto the 3D shape of the excised tissue so that suspicious regions can be precisely localized for targeted follow-up. We present a fully automated, calibration-free pipeline that produces a 3D hyperspectral point cloud of an ex-vivo lumpectomy specimen from a set of consumer-camera RGB images and a single top-down HSI acquisition. The 3D geometry is reconstructed with a deep-learning Structure-from-Motion backbone, stabilized in a metric reference frame by a custom bundle adjustment that enforces consistency on the corners of four ArUco markers placed around the specimen. The HSI cube is then registered to the reconstruction without recovering the HSI camera pose: the markers, visible in both modalities, define 16 corner correspondences that drive a planar homography, and 3D coordinates are recovered by lookup on an orthographically rendered depth map. Evaluated on two ex-vivo lumpectomy specimens, the pipeline achieves a median 3D registration error below 1~mm and a 2D reprojection error below 0.02 mm, with a total per-specimen processing time under 4 minutes on accelerated hardware. These results support the feasibility of integrating HSI-guided spatial localization into intraoperative margin assessment workflows for breast-conserving surgery.

高光谱成像3D重建手术导航乳腺癌

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。