让视觉语言模型的推理过程可解释,且减少幻觉。
Concept-RuleNet: Grounded Multi-Agent Neurosymbolic Reasoning in Vision Language Models
- 用图像直接提取视觉概念,再生成带真实数据依据的符号。
- 在5个基准上提升准确率平均5%,幻觉符号减少50%。
- 适合医疗影像等需高可信度推理的场景。
现代视觉语言模型虽预测准确,但缺乏决策依据,尤其在分布外数据下常出现事实幻觉。神经符号框架通过结合黑箱感知与可解释符号推理解决此问题,但现有方法仅从任务标签提取符号,导致符号与视觉数据关联弱。本文提出多智能体系统 Concept-RuleNet,重新建立视觉基础并保持推理透明性:首先,多模态概念生成器从训练图像子集直接挖掘判别性视觉概念;其次,这些视觉概念用于条件化符号发现,使生成锚定于真实图像统计,缓解标签偏差;随后,大语言模型推理智能体将符号组合成可执行的一阶规则,生成可解释的神经符号规则;最后,在推理时,视觉验证智能体量化每个符号的出现程度,并与黑箱神经模型输出协同触发规则执行,实现带显式推理路径的预测。在五个基准上,包括两项挑战性的医学影像任务和三项代表性不足的自然图像数据集,本系统相较当前最优神经符号基线平均提升5%准确率,同时将规则中幻觉符号的发生率降低高达50%。
原文摘要 · Abstract (English)
Modern vision-language models (VLMs) deliver impressive predictive accuracy yet offer little insight into 'why' a decision is reached, frequently hallucinating facts, particularly when encountering out-of-distribution data. Neurosymbolic frameworks address this by pairing black-box perception with interpretable symbolic reasoning, but current methods extract their symbols solely from task labels, leaving them weakly grounded in the underlying visual data. In this paper, we introduce a multi-agent system - Concept-RuleNet that reinstates visual grounding while retaining transparent reasoning. Specifically, a multimodal concept generator first mines discriminative visual concepts directly from a representative subset of training images. Next, these visual concepts are utilized to condition symbol discovery, anchoring the generations in real image statistics and mitigating label bias. Subsequently, symbols are composed into executable first-order rules by a large language model reasoner agent - yielding interpretable neurosymbolic rules. Finally, during inference, a vision verifier agent quantifies the degree of presence of each symbol and triggers rule execution in tandem with outputs of black-box neural models, predictions with explicit reasoning pathways. Experiments on five benchmarks, including two challenging medical-imaging tasks and three underrepresented natural-image datasets, show that our system augments state-of-the-art neurosymbolic baselines by an average of 5% while also reducing the occurrence of hallucinated symbols in rules by up to 50%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。