解决模型预测不一致问题,提升高风险场景的可靠性
Resolving Predictive Multiplicity for the Rashomon Set
- 通过修正异常样本降低局部预测方差
- 利用验证集检测并修复局部偏差,减少模型分歧
- 成对调整不一致预测,适合部署可解释模型
同一预测任务存在多个精度相当但预测结果不同的模型,形成预测多解性(Rashomon set),导致预测不一致,影响高风险应用的信任度。本文提出三种方法:1)异常值修正——识别无法被优质模型正确预测的异常样本,修复后降低局部预测方差;2)局部修补——在测试点邻域内检测并修正模型偏差,利用验证集实现;3)成对调和——识别在测试点附近产生分歧的模型对,调整其不一致预测以减少偏见。三种方法可独立或联合使用,最终将协调后的预测蒸馏为单一可解释模型用于实际部署。在多个数据集上的实验表明,该方法在保持竞争力准确率的同时显著降低分歧度。
原文摘要 · Abstract (English)
The existence of multiple, equally accurate models for a given predictive task leads to predictive multiplicity, where a Rashomon set of models achieve similar accuracy but diverge in their individual predictions. This inconsistency undermines trust in high-stakes applications where we want consistent predictions. We propose three approaches to reduce inconsistency among predictions for the members of the Rashomon set. The first approach is outlier correction. An outlier has a label that none of the good models are capable of predicting correctly. Outliers can cause the Rashomon set to have high variance predictions in a local area, so fixing them can lower variance. Our second approach is local patching. In a local region around a test point, models may disagree with each other because some of them are biased. We can detect and fix such biases using a validation set, which also reduces multiplicity. Our third approach is pairwise reconciliation, where we find pairs of models that disagree on a region around the test point. We modify predictions that disagree, making them less biased. These three approaches can be used together or separately, and they each have distinct advantages. The reconciled predictions can then be distilled into a single interpretable model for real-world deployment. In experiments across multiple datasets, our methods reduce disagreement metrics while maintaining competitive accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。