将神经符号与置信预测结合,提升模型可靠性与可解释性。
Neurosymbolic Conformal Classification
- 用符号规则约束神经网络输出,增强推理可信度
- 生成带统计保证的预测集合,真标签包含率有保障
- 适合需要高可靠性、可解释性的关键领域应用
近几十年来,机器学习(ML)在深度学习推动下取得显著进展。然而,由于无法提供一致性保证以及系统对分布偏移、对抗攻击等的脆弱性,可信AI系统仍难以构建。为缓解这一问题,研究者探索了多种路径,包括神经符号人工智能和置信预测。神经符号AI旨在融合神经网络的学习能力与符号系统的推理能力,以确保输出符合先验知识。置信预测则通过将单一预测转化为包含真实标签的概率集(置信集),提供统计保证。二者均不依赖特定分布且对模型无限制。本文探讨两者如何互补,提出多种神经符号置信预测方法,并分析其在置信集大小、计算复杂度等方面的特性。
原文摘要 · Abstract (English)
The last decades have seen a drastic improvement of Machine Learning (ML), mainly driven by Deep Learning (DL). However, despite the resounding successes of ML in many domains, the impossibility to provide guarantees of conformity and the fragility of ML systems (faced with distribution shifts, adversarial attacks, etc.) have prevented the design of trustworthy AI systems. Several research paths have been investigated to mitigate this fragility and provide some guarantees regarding the behavior of ML systems, among which are neurosymbolic AI and conformal prediction. Neurosymbolic artificial intelligence is a growing field of research aiming to combine neural network learning capabilities with the reasoning abilities of symbolic systems. One of the objective of this hybridization can be to provide theoritical guarantees that the output of the system will comply with some prior knowledge. Conformal prediction is a set of techniques that enable to take into account the uncertainty of ML systems by transforming the unique prediction into a set of predictions, called a confidence set. Interestingly, this comes with statistical guarantees regarding the presence of the true label inside the confidence set. Both approaches are distribution-free and model-agnostic. In this paper, we see how these two approaches can complement one another. We introduce several neurosymbolic conformal prediction techniques and explore their different characteristics (size of confidence sets, computational complexity, etc.).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。