通过关系建模提升手术器械实例分割的准确性
Topology-Aware Query Selection for Surgical Instrument Instance Segmentation
- 构建候选框的完整图结构,学习成对关系与集合基数
- 实例F1提升0.0504~0.0612,正帧集合失败率下降0.0848~0.1060
- 适用于固定Mask2Former框架下的精准实例构造任务
准确的前景掩码仍可能形成错误的手术器械实例集合:重复、碎片化、合并、遗漏或空帧预测虽保持良好的像素重叠,却违背了物体身份与数量。因此,最终查询选择是具有可变基数的关系性问题,而非独立候选决策的集合。我们评估了拓扑感知的查询选择方法,将固定Mask2Former的非空候选表示为完全图,学习候选与成对关系表征,预测集合基数,并求解精确的结构子集问题。形式化对比为完整关系路径与节点特征匹配路径,评估成对几何、消息传递及额外关系路径容量的综合效果,而非单一组件。在22例封闭测试集中,所有三个发现种子均支持实例集性能提升,同时保持分割保真度与预定义技术安全性:实例F1提升0.0504–0.0612,正帧集合失败率降低0.0848–0.1060。直接ROBUST-MIPS迁移在所有三个种子中复现了完整结果。Endoscapes仅在一个种子中成功,故未建立稳定的直接迁移能力。总体而言,结果支持有限结论:所评估的完整路径在特定原生实例合约下,提升了固定Mask2Former候选的连贯实例集构建能力,而跨域稳定迁移与组件特异性效应仍待验证。
原文摘要 · Abstract (English)
Accurate foreground masks can still form an incorrect surgical-instrument instance set: duplicate, fragmented, merged, missed, or empty-frame predictions may preserve favorable pixel overlap while violating object identity and count. Final query selection is therefore a relational, variable-cardinality problem rather than a collection of independent candidate decisions. We evaluate topology-aware query selection, which represents the nonempty candidates of a fixed Mask2Former as a complete graph, learns relational candidate and pair representations, predicts set cardinality, and solves an exact structured subset problem. The formal comparison is the complete relational path versus a node-feature-matched path; it evaluates the combined effect of pairwise geometry, message passing, and the additional relational-path capacity, not an isolated component. On the sealed 22-case source test, all three discovery seeds supported instance-set performance improvement with segmentation fidelity and predefined technical-safety preservation: instance F1 increased by 0.0504--0.0612 and positive-frame set-failure rate decreased by 0.0848--0.1060. Direct ROBUST-MIPS transfer reproduced the complete result in all three seeds. Endoscapes supported only one of three seeds and therefore did not establish stable direct transfer. Taken together, the results support a bounded conclusion: the evaluated complete path improved coherent instance-set construction from fixed Mask2Former candidates in specified native-instance contracts, while stable cross-domain transfer and component-specific effects remain unestablished.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。