让神经网络自己发现并运用逻辑规则,提升图像识别鲁棒性。
Learning to Reason: Targeted Knowledge Discovery and Fuzzy Logic Update for Robust Image Recognition

- 通过可微知识单元自动挖掘隐含概念与类别的逻辑关系。
- 在PASCAL-VOC、COCO和MedMNIST上均实现性能提升。
- 无需人工标注概念,适合缺乏先验知识的视觉任务。
将领域知识融入深度神经网络是提升泛化能力的有前途方法。现有方法或在损失函数中编码先验知识,或使用后处理模块,但都依赖于可用的符号知识。由于真实视觉任务中常缺乏此类规则,本文提出一种针对性的知识发现方法。我们设计了可微知识单元(DKU),通过模糊推理对分类器输出进行逻辑修正,生成更精确的类别概率。DKU利用蕴含规则表示类别与隐含概念之间的关系,这些概念由专用分类器学习,无需标签。概念概率与主类别概率一并输入DKU,经模糊推理生成调整向量,用于调节主类别得分。当概念不支持逻辑结构时,调整后的概率不会直接优化监督损失,从而隐式训练概念分类器。我们构建双向逻辑关系规则库,并强制概念间及概念与类别间互异,以确保清晰的监督信号。在PASCAL-VOC、COCO和MedMNIST数据集上验证,知识整合显著提升性能。领域泛化与难例消融实验表明,该方法优于基线。
原文摘要 · Abstract (English)
Integrating domain knowledge into deep neural networks is a promising way to improve generalization. Existing methods either encode prior knowledge in the loss function or apply post-processing modules, but both depend on identifying useful symbolic knowledge to integrate. Since such rules are often unavailable in real-world vision tasks, we propose a method for targeted knowledge discovery. We propose a Differentiable Knowledge Unit (DKU) that enables modulating the classifier logits, yielding refined class probabilities. The DKU uses implication rules to represent relationships between task classes and implicit concepts learned entirely from the main task supervision, without requiring concept labels. Concepts are identified by dedicated classifiers, whose probabilities are passed to DKU alongside the primary class probabilities. DKU computes a logic-based adjustment vector via fuzzy inference, which modulates the primary class logits to yield refined class probabilities. When concept classifiers represent concepts that do not support the logical rule structure, the resulting adjustments to the class probabilities do not directly minimize the supervision loss. Consequently, optimizing the supervision loss on these adjusted class probabilities implicitly trains the concept classifiers. We construct the rule base so that bidirectional logical relations connect concepts and classes. We enforce the concepts to be distinct from each other and with respect to the classes. This design enforces a clean supervision signal for concept learning. We evaluate our methods on the PASCAL-VOC, COCO, and MedMNIST datasets. We demonstrate improvement through our knowledge integration across these datasets. We conduct domain generalization and hard-sample ablation studies and find that our implicit knowledge discovery and integration outperforms the baseline.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。