arXiv:2603.23104cs.CV2026-03中稿 · CVPR被引 2

用2D视觉模型初始化3D神经元分割,提升重建精度与数据效率

NeuroSeg Meets DINOv3: Transferring 2D Self-Supervised Visual Priors to 3D Neuron Segmentation via DINOv3 Initialization

  • 将DINOv3的2D视觉表征通过滤波器膨胀转为3D,保留语义先验
  • 在4个数据集上平均提升3.8%的结构相似度,优于当前最优方法
  • 适合需要高精度神经形态重建的生物医学研究者

2D视觉基础模型(如在大规模自然图像上训练的自监督模型DINOv3)展现出强大的零样本泛化能力,能捕捉丰富的全局上下文和细粒度结构线索。然而,由于3D图像获取困难及高质量标注稀缺,目前尚无对应的3D基础模型用于下游体积神经影像任务。为此,我们提出将DINOv3学习到的2D视觉表征适配到3D生物医学分割模型中,实现更高效的数据利用和更忠实的神经元形态重建。具体地,设计了一种基于膨胀的适配策略,将2D卷积核扩展为3D算子,保留DINOv3的语义先验并适应3D神经元体块;同时引入拓扑感知的骨架损失,显式约束基于图的神经元树突重构结构保真度。在四个神经元成像数据集(包括两个BigNeuron数据集及NeuroFly、CWMBS公开数据集)上的大量实验表明,该方法在重建准确率上持续超越现有最先进方法,平均提升2.9%(整个结构平均)、2.8%(不同结构平均)和3.8%(不同结构占比)。代码已开源:https://github.com/yy0007/NeurINO。

原文摘要 · Abstract (English)

2D visual foundation models, such as DINOv3, a self-supervised model trained on large-scale natural images, have demonstrated strong zero-shot generalization, capturing both rich global context and fine-grained structural cues. However, an analogous 3D foundation model for downstream volumetric neuroimaging remains lacking, largely due to the challenges of 3D image acquisition and the scarcity of high-quality annotations. To address this gap, we propose to adapt the 2D visual representations learned by DINOv3 to a 3D biomedical segmentation model, enabling more data-efficient and morphologically faithful neuronal reconstruction. Specifically, we design an inflation-based adaptation strategy that inflates 2D filters into 3D operators, preserving semantic priors from DINOv3 while adapting to 3D neuronal volume patches. In addition, we introduce a topology-aware skeleton loss to explicitly enforce structural fidelity of graph-based neuronal arbor reconstruction. Extensive experiments on four neuronal imaging datasets, including two from BigNeuron and two public datasets, NeuroFly and CWMBS, demonstrate consistent improvements in reconstruction accuracy over SoTA methods, with average gains of 2.9% in Entire Structure Average, 2.8% in Different Structure Average, and 3.8% in Percentage of Different Structure. Code: https://github.com/yy0007/NeurINO.

3D分割视觉预训练神经元重建DINOv3

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。