用超网络自组织训练,自动识别医学影像中的标注偏差。
HyperSORT: Self-Organising Robust Training with hyper-networks
- 用潜变量控制超网络生成分割模型参数,学习数据分布
- 在两个3D腹部CT数据集上,成功识别出系统性偏差和错误样本
- 适合处理带噪声或不一致标注的医疗影像数据
医学影像数据常包含从错误标签到标注风格不一致等异质性偏差,这些偏差会损害深度分割网络性能。然而,识别和表征此类偏差极为繁琐且具有挑战性。本文提出HyperSORT框架,利用超网络根据代表图像与标注变异性的潜变量生成UNet参数。超网络参数与训练集中每个样本对应的潜向量联合学习。因此,不同于优化单一神经网络拟合数据集,HyperSORT学习一个复杂的UNet参数分布:低密度区域捕捉特定噪声模式,而高密度主峰则以差异化但有意义的方式稳健分割器官。我们在两个3D腹部CT公开数据集上验证方法:一是经合成扰动的AMOS数据集,二是包含真实未知偏差与错误的大规模TotalSegmentator数据集。实验表明,HyperSORT构建了结构化数据映射,可识别相关系统性偏差与异常样本;潜空间聚类产生符合底层学习偏差的分割模型参数。代码及TotalSegmentator数据分析已公开:https://github.com/ImFusionGmbH/HyperSORT
原文摘要 · Abstract (English)
Medical imaging datasets often contain heterogeneous biases ranging from erroneous labels to inconsistent labeling styles. Such biases can negatively impact deep segmentation networks performance. Yet, the identification and characterization of such biases is a particularly tedious and challenging task. In this paper, we introduce HyperSORT, a framework using a hyper-network predicting UNets' parameters from latent vectors representing both the image and annotation variability. The hyper-network parameters and the latent vector collection corresponding to each data sample from the training set are jointly learned. Hence, instead of optimizing a single neural network to fit a dataset, HyperSORT learns a complex distribution of UNet parameters where low density areas can capture noise-specific patterns while larger modes robustly segment organs in differentiated but meaningful manners. We validate our method on two 3D abdominal CT public datasets: first a synthetically perturbed version of the AMOS dataset, and TotalSegmentator, a large scale dataset containing real unknown biases and errors. Our experiments show that HyperSORT creates a structured mapping of the dataset allowing the identification of relevant systematic biases and erroneous samples. Latent space clusters yield UNet parameters performing the segmentation task in accordance with the underlying learned systematic bias. The code and our analysis of the TotalSegmentator dataset are made available: https://github.com/ImFusionGmbH/HyperSORT
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。