神经符号模型在特定条件下更可靠,尤其擅长处理高维输入和算术推理。
On the Promise for Assurance of Differentiable Neurosymbolic Reasoning Paradigms
- 用可微神经符号框架整合神经网络与逻辑推理,提升模型可解释性
- 高维输入或算术任务中表现优于纯神经网络,但对对抗攻击更脆弱
- 数据效率仅在类别不平衡问题中明显,适合需要可解释性的场景
为构建可用且可部署的人工智能系统,需确保其在多种条件下的性能可靠性。许多部署的机器学习系统需结合神经网络感知与经典逻辑推理,通过神经符号程序实现。尽管已有研究关注单一组件(如纯神经网络或整体系统)的可靠性,但针对集成神经符号系统的保障研究仍较少。本文基于可微端到端神经符号库Scallop,评估了图像与音频分类及推理任务中此类系统在对抗鲁棒性、校准度、用户性能公平性以及解法可解释性方面的保障能力。实验发现,这类模型在定义算术操作或输入空间维度较高时,具有更高保障性,而纯神经网络在此类任务中难以学习稳健的推理机制。同时,模型可解释性虽有助于发现偏差路径,却可能因简化策略导致对抗脆弱性。此外,数据效率优势主要出现在类别不平衡的推理问题中。
原文摘要 · Abstract (English)
To create usable and deployable Artificial Intelligence (AI) systems, there requires a level of assurance in performance under many different conditions. Many times, deployed machine learning systems will require more classic logic and reasoning performed through neurosymbolic programs jointly with artificial neural network sensing. While many prior works have examined the assurance of a single component of the system solely with either the neural network alone or entire enterprise systems, very few works have examined the assurance of integrated neurosymbolic systems. Within this work, we assess the assurance of end-to-end fully differentiable neurosymbolic systems that are an emerging method to create data-efficient and more interpretable models. We perform this investigation using Scallop, an end-to-end neurosymbolic library, across classification and reasoning tasks in both the image and audio domains. We assess assurance across adversarial robustness, calibration, user performance parity, and interpretability of solutions for catching misaligned solutions. We find end-to-end neurosymbolic methods present unique opportunities for assurance beyond their data efficiency through our empirical results but not across the board. We find that this class of neurosymbolic models has higher assurance in cases where arithmetic operations are defined and where there is high dimensionality to the input space, where fully neural counterparts struggle to learn robust reasoning operations. We identify the relationship between neurosymbolic models' interpretability to catch shortcuts that later result in increased adversarial vulnerability despite performance parity. Finally, we find that the promise of data efficiency is typically only in the case of class imbalanced reasoning problems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。