重新定义实例匹配,统一处理全景分割中的部分感知评估
Redefining Instance Matching: A Unified Framework for Part-Aware Matching in Panoptic Segmentation Evaluation

- 将匹配问题建模为带约束的二分图分配,提出四种匹配策略
- 在0.5以下交并比时仍能准确计算,提升碎片化与噪声场景下的评估可靠性
- 支持生物医学数据的部分感知评估,开源工具可配置多种分析模式
全景质量(PQ)是联合评估实例分割与语义分割的标准指标。然而其原始定义依赖于预测与真实分割之间的单对单匹配,仅在交并比(IoU)超过0.5时清晰可行;低于0.5时,多种匹配策略涌现但研究不足。本文系统阐述这一未充分探索的问题空间,将分割匹配重构为受限的二分图分配问题。通过独立约束预测端和真实端的度数,提出四种匹配策略:单对单、多对一、一对多、多对多。证明前三种在PQ框架内有明确定义,而多对多则超出该框架。这些策略在实例碎片化、相邻物体难区分或标注噪声等情况下尤为关键。本框架的核心是基于顶点的真正例(TP)、假反例(FN)与假正例(FP)统计,锚定于真实与预测分割而非匹配边。进一步表明该框架可自然拓展至部分感知全景分割,并在生物医学数据上进行了部分感知评估。通过可配置的案例研究,报告了不同阈值与匹配策略的实际表现。我们发布了基于Panoptica的统一开源包,支持基于沃罗诺伊的区域分析、部分感知评估及阈值曲线下面积计算等可配置选项。
原文摘要 · Abstract (English)
The Panoptic Quality (PQ) metric is the standard for jointly evaluating instance and semantic segmentation. However, its original definition relies on a One-to-One matching between predicted and ground truth segments, which is only straightforward when the IoU threshold exceeds 0.5. Below 0.5, multiple matching strategies emerge in a poorly explored problem space. We systematically elucidate this space by recasting segment matching as a constrained bipartite assignment problem. Independently bounding the prediction- and ground-truth-side degrees yields four matching strategies: One-to-One, Many-to-One, One-to-Many, and Many-to-Many. We show that the first three are well-defined within the PQ framework, while Many-to-Many falls outside it. These strategies become relevant when instances are fragmented, adjacent objects are difficult to delineate, or annotations are noisy. Central to our framework is a vertex-based accounting of TP, FN, and FP, anchored to ground truth and predicted segments rather than to matching edges. We further show that the framework extends naturally to part-aware panoptic segmentation, and we explore part-aware evaluation on biomedical data. Across configurable case studies we report how different combinations of thresholds and matching strategies behave in practice. We release a unified open-source package built on Panoptica. It exposes Voronoi-based region-wise analysis, part-aware evaluation, and Area Under Threshold Curve computations as configurable options.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。