用距离图回归实现3D脑影像分割的高效高分辨率上采
Learning to Upscale 3D Segmentations in Neuroimaging
- 通过预测符号距离图实现边界感知的跨分辨率上采
- 单类逐个预测大幅降低内存占用,支持大体积3D数据
- 在100μm级超高清脑影像上表现优于传统方法
从粗略标注中获取高分辨率(HR)分割是计算机视觉中的普遍挑战。应用场景包括从视觉变换器的标记级标签推断像素级分割、将粗略掩码上采样至全分辨率,以及将旧低分辨率(LR)数据集的标注迁移到现代高分辨率图像。这类问题在3D神经影像学中尤为突出,因人工标注成本高且分辨率持续提升。我们提出一种可扩展框架,通过回归符号距离图实现跨分辨率与跨域泛化,提供平滑且边界敏感的监督。关键在于模型逐类预测,显著降低训练与推理时的内存消耗(对大体积3D数据至关重要),并自然支持未见类别的泛化。通过在合成领域随机化数据上训练进一步提升泛化能力。我们在超高清(UHR)人类脑部MRI(约100μm)上验证该方法,而现有多数方法仅在1mm分辨率下运行。本框架能有效将标准分辨率分割上采样至UHR细节。合成与真实数据结果均表明,相比传统分割方法,该方法具备更优的可扩展性与泛化能力。代码已开源:https://github.com/HuXiaoling/Learn2Upscale。
原文摘要 · Abstract (English)
Obtaining high-resolution (HR) segmentations from coarse annotations is a pervasive challenge in computer vision. Applications include inferring pixel-level segmentations from token-level labels in vision transformers, upsampling coarse masks to full resolution, and transferring annotations from legacy low-resolution (LR) datasets to modern HR imagery. These challenges are especially acute in 3D neuroimaging, where manual labeling is costly and resolutions continually increase. We propose a scalable framework that generalizes across resolutions and domains by regressing signed distance maps, enabling smooth, boundary-aware supervision. Crucially, our model predicts one class at a time, which substantially reduces memory usage during training and inference (critical for large 3D volumes) and naturally supports generalization to unseen classes. Generalization is further improved through training on synthetic, domain-randomized data. We validate our approach on ultra-high-resolution (UHR) human brain MRI (~100 μm), where most existing methods operate at 1 mm resolution. Our framework effectively upsamples such standard-resolution segmentations to UHR detail. Results on synthetic and real data demonstrate superior scalability and generalization compared to conventional segmentation methods. Code is available at: https://github.com/HuXiaoling/Learn2Upscale.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。