arXiv:2505.12155cs.CVcs.AI2025-05被引 3

提出软匹配评估法,让分割模型得分更平滑、更真实反映改进。

SoftPQ: Robust Instance Segmentation Evaluation via Soft Matching and Tunable Thresholds

  • 用可调阈值和非线性惩罚,将分割评估从二元判断转为渐进评分
  • 在扰动实验中,能区分传统指标忽略的细微质量差异
  • 适合模型迭代优化与需要细致反馈的研究者使用

传统分割评估依赖二元判断:预测结果要么正确,要么错误,基于固定的交并比(IoU)阈值。检测类指标如F1和mAP以固定重叠率判定对象级别正确性,而像素级指标如IoU和Dice常忽视实例级结构。全景质量(PQ)试图统一检测与分割评估,但仍依赖硬阈值匹配——低于阈值的预测被视为完全错误。这种二元框架掩盖了不同类型错误的重要差异,且无法体现模型渐进改进。我们提出SoftPQ,一种灵活可解释的实例分割评估指标,将评价重构为连续量度而非二元分类。SoftPQ引入可调的上下限IoU阈值定义部分匹配区域,并对模糊或碎片化预测应用次线性惩罚函数。该设计使SoftPQ具备更平滑的分数变化、更强的结构误差鲁棒性,以及更丰富的模型开发反馈。通过受控扰动实验,我们证明SoftPQ能捕捉现有指标忽略的有意义分割质量差异,是基准测试与迭代模型优化的实用且合理的替代方案。

原文摘要 · Abstract (English)

Segmentation evaluation metrics traditionally rely on binary decision logic: predictions are either correct or incorrect, based on rigid IoU thresholds. Detection--based metrics such as F1 and mAP determine correctness at the object level using fixed overlap cutoffs, while overlap--based metrics like Intersection over Union (IoU) and Dice operate at the pixel level, often overlooking instance--level structure. Panoptic Quality (PQ) attempts to unify detection and segmentation assessment, but it remains dependent on hard-threshold matching--treating predictions below the threshold as entirely incorrect. This binary framing obscures important distinctions between qualitatively different errors and fails to reward gradual model improvements. We propose SoftPQ, a flexible and interpretable instance segmentation metric that redefines evaluation as a graded continuum rather than a binary classification. SoftPQ introduces tunable upper and lower IoU thresholds to define a partial matching region and applies a sublinear penalty function to ambiguous or fragmented predictions. These extensions allow SoftPQ to exhibit smoother score behavior, greater robustness to structural segmentation errors, and more informative feedback for model development and evaluation. Through controlled perturbation experiments, we show that SoftPQ captures meaningful differences in segmentation quality that existing metrics overlook, making it a practical and principled alternative for both benchmarking and iterative model refinement.

实例分割评估指标软匹配模型优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。