用逻辑一致性方法融合多个模型的错误预测,提升新环境下的感知鲁棒性。
Consistency-based Abductive Reasoning over Perceptual Errors of Multiple Pre-trained Models in Novel Environments
- 基于逻辑规则构建多模型预测的反演推理框架,动态筛选可靠结果。
- 在15个测试集上相较最优单模型提升13.6% F1-score与16.6%准确率。
- 适合需要高可靠性感知的自动驾驶、遥感等新场景应用。
预训练感知模型在新环境中部署时常因分布偏移导致性能下降。尽管现有元认知方法利用逻辑规则识别并过滤模型错误,但提高精度常以降低召回率为代价。本文提出,利用多个预训练模型可缓解召回率下降问题。我们将不同模型间冲突预测的识别与管理建模为基于一致性的反演推理问题,基于反演学习(ABL)思想,但应用于测试阶段而非训练阶段。各模型的输入预测及学习到的错误检测规则被编码为逻辑程序,目标是寻找一组能最大化预测覆盖度且逻辑不一致率低于阈值的反演解释。为此,我们提出两种算法:基于整数规划(IP)的精确解法和高效的启发式搜索(HS)。在包含可控复杂分布偏移的模拟航空影像数据集上,实验表明该反演框架优于单模型及标准集成基线,在15个多样化测试集上平均实现约13.6%的F1-score提升和16.6%的准确率提升。结果验证了基于一致性的反演推理在复杂新颖场景中有效整合多个不完备模型知识的可行性。
原文摘要 · Abstract (English)
The deployment of pre-trained perception models in novel environments often leads to performance degradation due to distributional shifts. Although recent artificial intelligence approaches for metacognition use logical rules to characterize and filter model errors, improving precision often comes at the cost of reduced recall. This paper addresses the hypothesis that leveraging multiple pre-trained models can mitigate this recall reduction. We formulate the challenge of identifying and managing conflicting predictions from various models as a consistency-based abduction problem, building on the idea of abductive learning (ABL) but applying it to test-time instead of training. The input predictions and the learned error detection rules derived from each model are encoded in a logic program. We then seek an abductive explanation--a subset of model predictions--that maximizes prediction coverage while ensuring the rate of logical inconsistencies (derived from domain constraints) remains below a specified threshold. We propose two algorithms for this knowledge representation task: an exact method based on Integer Programming (IP) and an efficient Heuristic Search (HS). Through extensive experiments on a simulated aerial imagery dataset featuring controlled, complex distributional shifts, we demonstrate that our abduction-based framework outperforms individual models and standard ensemble baselines, achieving, for instance, average relative improvements of approximately 13.6\% in F1-score and 16.6\% in accuracy across 15 diverse test datasets when compared to the best individual model. Our results validate the use of consistency-based abduction as an effective mechanism to robustly integrate knowledge from multiple imperfect models in challenging, novel scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。