提出可拒答的结构化预测新方法,提升模型可信度与可解释性。
Structured Prediction with Abstention via the Lovász Hinge
- 引入可拒答机制,允许对部分预测结果选择不输出
- 证明洛瓦斯铰链在特定条件下能保持一致性,避免错误决策
- 适用于图像分割等需要可信预测的场景,增强模型可解释性
洛瓦斯铰链是一种用于二元结构化分类的凸损失函数,其通过次模函数联合评估k个相关二元预测。尽管在图像分割等任务中广泛应用,其一致性问题长期未解。本文证明,洛瓦斯铰链仅在评估集函数为模函数时才具有一致性。基于Finocchiaro等(2024)的嵌入框架,我们推导出使洛瓦斯铰链一致的目标损失,称之为结构化拒答问题,即结构化预测中的选择性分类变体,允许对任意子集的二元预测进行拒答。我们提出一族链接函数,对所有多面体函数(polymatroids,次模函数的子集)均一致。进一步给出多面体函数的充分条件,使得结构化拒答问题能被洛瓦斯铰链紧密嵌入,即无冗余目标预测。实验验证该方法在结构化分类任务中具备显著可解释性潜力。最后,在多分类设置下,结合Ramaswamy等(2018)的二进制编码构造,我们实现了自然多分类推广的高效一致代理损失。
原文摘要 · Abstract (English)
The Lovász hinge is a convex loss function proposed for binary structured classification, in which k related binary predictions jointly evaluated by a submodular function. Despite its prevalence in image segmentation and related tasks, the consistency of the Lovász hinge has remained open. We show that the Lovász hinge is inconsistent with its desired target unless the set function used for evaluation is modular. Leveraging the embedding framework of Finocchiaro et al. (2024), we find the target loss for which the Lovász hinge is consistent. This target, which we call the structured abstain problem, is a variant of selective classification for structured prediction that allows one to abstain on any subset of the k binary predictions. We derive a family of link functions, each of which is simultaneously consistent for all polymatroids, a subset of submodular set functions. We then give sufficient conditions on the polymatroid for the structured abstain problem to be tightly embedded by the Lovász hinge, meaning no target prediction is redundant. We experimentally demonstrate the potential of the structured abstain problem for interpretability in structured classification tasks. Finally, for the multiclass setting, we show that one can combine the binary encoding construction of Ramaswamy et al. (2018) with our link construction to achieve an efficient consistent surrogate for a natural multiclass generalization of the structured abstain problem.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。