手术分割模型在图像退化时会误判却仍自信,新方法融合多种视觉线索提升故障监测可靠性。
Beyond Uncertainty: Generalizable Failure Monitoring for Surgical Segmentation under Acquisition Degradation

- 结合形状、时序一致性与图像质量等可观测信号,超越传统置信度监测
- 在未见退化条件下仍有效,误报率低于40%的基准方法,显著提升泛化能力
- 适用于临床部署中无真值、无模型内部信息的场景,适合医疗AI安全监控
手术分割网络在图像采集退化时可能无声失效:预测掩码错误但模型置信度仍高。现有部署期监测主要依赖不确定性估计,因而可能遗漏高置信度下的失败。本文提出TCSR-Monitor(时序共形手术风险监测器),一种后处理故障监测框架,融合置信度、可观察形状、时序一致性与图像质量线索。该框架封装冻结的分割模型,无需模型内部信息,部署时无需真值。我们还引入验证协议,评估警报在分布偏移下的可信性。在EndoVis 2017数据集上,留一退化测试显示TCSR-Monitor能泛化至未见退化,显著优于基于置信度的基线。循环性控制表明其预测的是分割失败而非单纯检测损坏图像。Mondrian共形校准在不同退化强度间平衡漏报率,但单一全局阈值在中等退化下仍导致高达40%的正确帧误报。零样本迁移至SAM2验证特征可移植性,但熵仍优于迁移后的监测器。总体表明,可靠监测需融合置信度以外的可观测信号,但误报与迁移性能仍有显著局限。
原文摘要 · Abstract (English)
Surgical segmentation networks can fail silently under acquisition degradation: predicted masks may be wrong even when model confidence remains high. Existing deployment-time monitors rely primarily on uncertainty estimates and can therefore miss confident failures. We present TCSR-Monitor (Temporal Conformal Surgical Risk Monitor), a post-hoc failure-monitoring framework that combines confidence with observable shape, temporal-consistency, and image-quality cues. TCSR-Monitor wraps a frozen segmentation model, requires no model internals, and operates without ground truth at deployment. We also introduce a validation protocol to assess whether alarms remain credible under distribution shift. On EndoVis 2017, leave-one-corruption-out evaluation shows that TCSR-Monitor generalizes to unseen acquisition degradations and substantially outperforms confidence-based baselines. A circularity control confirms that it predicts segmentation failure rather than simply detecting corrupted images. Mondrian conformal calibration balances miss-rates across degradation severities, but a single global threshold still produces false alarms on up to 40% of correctly segmented frames at moderate corruption. Zero-shot transfer to SAM2 demonstrates feature portability, although entropy outperforms the transferred monitor at both evaluated thresholds. Overall, reliable monitoring under acquisition degradation benefits from complementary observable signals beyond confidence alone, but substantial false-alarm and transfer limitations remain.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。