用二进制编码替代独热码,降低大规模脑图谱分割的计算开销。
Beyond one-hot encoding? Journey into compact encoding for large multi-class segmentation
- 改用二进制编码,将计算复杂度从线性降至对数级。
- 108类脑分区任务中,性能下降明显,最佳DSC仅73.8(原为82.4)。
- 揭示紧凑编码在医学图像分割中的局限性,警示后续研究。
本文提出新型方法,降低具有大量类别的医学图像分割任务的计算与内存开销。传统基于学习的方法通常采用独热编码,导致复杂度随类别数线性增长。我们改用二进制编码族,使复杂度降为对数级别。探索了纠错输出码(ECOCs)、类别加权、硬/软解码、类到码字映射及标签嵌入树等策略。在基于3D MRI的全脑分区任务(108类)上测试,尽管二进制编码在计算机视觉极端分类中表现优异,但分割质量显著下降:相较于独热编码的DSC=82.4(2.8),二进制方法最高仅达73.8,最低39.3。这些负面结果常被忽视,本工作旨在推动未来紧凑编码策略的研究。
原文摘要 · Abstract (English)
This work presents novel methods to reduce computational and memory requirements for medical image segmentation with a large number of classes. We curiously observe challenges in maintaining state-of-the-art segmentation performance with all of the explored options. Standard learning-based methods typically employ one-hot encoding of class labels. The computational complexity and memory requirements thus increase linearly with the number of classes. We propose a family of binary encoding approaches instead of one-hot encoding to reduce the computational complexity and memory requirements to logarithmic in the number of classes. In addition to vanilla binary encoding, we investigate the effects of error-correcting output codes (ECOCs), class weighting, hard/soft decoding, class-to-codeword assignment, and label embedding trees. We apply the methods to the use case of whole brain parcellation with 108 classes based on 3D MRI images. While binary encodings have proven efficient in so-called extreme classification problems in computer vision, we faced challenges in reaching state-of-the-art segmentation quality with binary encodings. Compared to one-hot encoding (Dice Similarity Coefficient (DSC) = 82.4 (2.8)), we report reduced segmentation performance with the binary segmentation approaches, achieving DSCs in the range from 39.3 to 73.8. Informative negative results all too often go unpublished. We hope that this work inspires future research of compact encoding strategies for large multi-class segmentation tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。