arXiv:2601.10412eess.IV2026-01中稿 · IMIP2026 Code: htt…

用预训练模型实现高效脑区细胞架构分割,仅需少量标注即可达到高精度。

An effective interactive brain cytoarchitectonic parcellation framework using pretrained foundation model

  • 基于DINOv3多层特征融合与轻量解码器,支持实时人工干预
  • 在稀疏标记下分割准确率显著优于从零训练的nnU-Net
  • 适合需要高精度脑区划分的研究者快速开展标注工作

细胞架构图谱为大脑结构提供解剖学基础分区,是多模态神经科学分析的重要基础。这类分区依赖于组织切片中神经元胞体的形态、密度和空间分布。近期研究已尝试使用深度学习实现大规模数据集上细胞架构区域的全自动分割,但性能受限于标注数据稀缺以及染色和成像条件的差异。为此,本文提出一种交互式细胞架构分区框架,利用DINOv3视觉变换器的强大迁移能力。该框架结合(i)多层DINOv3特征融合,(ii)轻量级分割解码器,(iii)基于稀疏涂鸦的实时用户引导训练。此设计可在保持高分割精度的同时实现快速人机协同优化。相比从零训练nnU-Net,DINOv3迁移学习显著提升性能。我们还发现DINOv3提取的特征具有明确解剖对应性,并验证了该方法在稀疏标签下进行脑区分割的实际效用。结果表明,基于基础模型的交互式分割有望推动可扩展、高效的细胞架构图谱构建。

原文摘要 · Abstract (English)

Cytoarchitectonic mapping provides anatomically grounded parcellations of brain structure and forms a foundation for integrative, multi-modal neuroscience analyses. These parcellations are defined based on the shape, density, and spatial arrangement of neuronal cell bodies observed in histological imaging. Recent works have demonstrated the potential of using deep learning models toward fully automatic segmentation of cytoarchitectonic areas in large-scale datasets, but performance is mainly constrained by the scarcity of training labels and the variability of staining and imaging conditions. To address these challenges, we propose an interactive cytoarchitectonic parcellation framework that leverages the strong transferability of the DINOv3 vision transformer. Our framework combines (i) multi-layer DINOv3 feature fusion, (ii) a lightweight segmentation decoder, and (iii) real-time user-guided training from sparse scribbles. This design enables rapid human-in-the-loop refinement while maintaining high segmentation accuracy. Compared with training an nnU-Net from scratch, transfer learning with DINOv3 yields markedly improved performance. We also show that features extracted by DINOv3 exhibit clear anatomical correspondence and demonstrate the method's practical utility for brain region segmentation using sparse labels. These results highlight the potential of foundation-model-driven interactive segmentation for scalable and efficient cytoarchitectonic mapping.

脑图谱图像分割预训练模型交互式学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。