arXiv:2602.23962eess.IVcs.CV2026-02

用分块重构法让2D模型实现新生儿脑部3D分割,精度达Dice 0.65。

Extending 2D foundational DINOv3 representations to 3D segmentation of neonatal brain MR images

  • 将3D MRI切分成小立方体,逐个处理再拼接
  • 在ALBERT数据集上单窗口分割Dice达0.65
  • 无需微调2D模型,适合医疗3D任务扩展

精确勾画海马结构对量化早产及足月婴儿的神经发育轨迹至关重要,细微形态差异可能具有预后意义。尽管基于大规模视觉数据训练的基座编码器提供判别性表征,但其二维形式限制了对脑部三维解剖结构的建模。本文提出一种体积分割策略,通过结构化的窗口拆解-重组机制解决这一矛盾:将全局MRI体积分解为非重叠的3D窗口(子立方体),每个窗口由独立的解码分支处理,该分支基于冻结的高保真特征;随后在稠密预测头前进行重组以对齐真实标注。该架构保持解码器内存恒定,强制预测符合解剖一致性。在ALBERT数据集上的海马分割评估显示,单3D窗口方法达到Dice分数0.65。结果表明,可通过结构化组合解码从冻结的2D基座表示中恢复体积解剖结构,为基座模型在3D医学应用中的可扩展、可泛化延伸提供了原则性方法。

原文摘要 · Abstract (English)

Precise volumetric delineation of hippocampal structures is essential for quantifying neurodevelopmental trajectories in pre-term and term infants, where subtle morphological variations may carry prognostic significance. While foundation encoders trained on large-scale visual data offer discriminative representations, their 2D formulation is a limitation with respect to the $3$D organization of brain anatomy. We propose a volumetric segmentation strategy that reconciles this tension through a structured window-based disassembly-reassembly mechanism: the global MRI volume is decomposed into non-overlapping 3D windows or sub-cubes, each processed via a separate decoding arm built upon frozen high-fidelity features, and subsequently reassembled prior to a ground-truth correspendence using a dense-prediction head. This architecture preserves constant a decoder memory footprint while forcing predictions to lie within an anatomically consistent geometry. Evaluated on the ALBERT dataset for hippocampal segmentation, the proposed approach achieves a Dice score of 0.65 for a single 3D window. The method demonstrates that volumetric anatomical structure could be recovered from frozen 2D foundation representations through structured compositional decoding, and offers a principled and generalizable extension for foundation models for 3D medical applications.

3D分割医学影像基座模型海马体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。