不训练就能选最轻量的U-Net,省时省力还高效。
XTinyU-Net: Training-Free U-Net Scaling via Initialization-Time Sensitivity

- 基于雅可比敏感度,在初始化时评估不同宽度的U-Net
- 在6个医学数据集上参数减少400至1600倍,精度接近基线
- 适合资源受限场景,无需训练即可快速部署
尽管U-Net仍是医学图像分割的金标准,但在资源受限环境下部署需极致压缩模型。然而,寻找最优配置通常需大量训练-评估循环,计算成本高昂。本文提出一种无需训练的自动选择框架,直接在初始化阶段识别超轻量、数据集特定的U-Net结构。我们发现,系统性缩小通道数会引发性能从稳定平台到表征能力崩溃的突变。为在不训练的前提下定位此边界,提出基于雅可比矩阵的敏感度指标,利用少量无标签图像对离散的宽度假设进行评分。通过分析该敏感度曲线的总变差,我们确定最小稳定配置,命名为XTinyU-Net。在nnU-Net框架下,针对六个多样化医学数据集的评估显示,XTinyU-Net仅用400倍至1600倍更少的参数,达到与重型nnU-Net基线相当的分割精度,并在参数量减少5倍至72倍的情况下超越现有轻量级架构。代码已公开于https://github.com/alvinkimbowa/nntinyunet.git。
原文摘要 · Abstract (English)
While U-Net architectures remain the gold standard for medical image segmentation, their deployment in resource-constrained environments demands aggressive model compression. However, finding an optimally efficient configuration is computationally prohibitive, typically requiring exhaustive train-and-evaluate cycles to find the smallest model that maintains peak performance. In this paper, we introduce a training-free selection framework to automatically identify ultralightweight, dataset-specific U-Net configurations directly at initialization. We observe that systematically scaling down U-Net channel width induces a sharp transition from a stable performance plateau to representational capacity collapse. To pinpoint this boundary without training, we propose a Jacobian-based sensitivity metric that scores discrete, width-capped U-Net variants using a small set of unlabeled images. By analyzing the total variation of this sensitivity curve, we isolate the smallest stable configuration, which we denote as XTinyU-Net. Evaluated across six diverse medical datasets within the nnU-Net framework, XTinyU-Net achieves segmentation accuracy comparable to the heavy nnU-Net baseline with 400x-1600x fewer parameters, and outperforms contemporary lightweight architectures while utilizing 5x-72x fewer parameters. Code is publicly accessible on https://github.com/alvinkimbowa/nntinyunet.git.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。