arXiv:2503.06427cs.LGcs.AI2025-03

预训练规则选择策略,让视觉生成推理更快更准。

Pre-Training Meta-Rule Selection Policy for Visual Generative Abductive Learning

  • 用符号嵌入构建元规则选择模型,提前筛选候选规则
  • 实验显示可显著减少搜索空间,提升学习效率
  • 适合研究视觉推理与逻辑生成融合的学者使用

视觉生成溯因学习旨在联合训练基于符号的神经视觉生成器并从数据中推导逻辑规则,使生成过程受推导出的规则引导。该任务的主要挑战在于逻辑溯因步骤时间成本高,尤其当符号集合大、规则复杂时。为此,本文提出一种针对近期提出的AbdGen方法[陈等,2023]的元规则选择策略预训练方法,旨在大幅缩小候选元规则集并剪枝搜索空间。该选择模型基于案例与元规则的符号嵌入表示构建,可有效融入神经模型与逻辑推理系统。预训练在纯符号数据上完成,不涉及原始视觉输入的符号对齐学习,使整体学习过程低开销。一个额外有趣的发现是,该选择策略能纠正预训练中未见过的符号对齐错误,源于注意力机制的记忆能力及符号模式的相对稳定性。实验表明,本方法能有效解决视觉溯因中的元规则选择问题,显著提升视觉生成溯因学习效率。代码见:https://github.com/future-item/metarule-select。

原文摘要 · Abstract (English)

Visual generative abductive learning studies jointly training symbol-grounded neural visual generator and inducing logic rules from data, such that after learning, the visual generation process is guided by the induced logic rules. A major challenge for this task is to reduce the time cost of logic abduction during learning, an essential step when the logic symbol set is large and the logic rule to induce is complicated. To address this challenge, we propose a pre-training method for obtaining meta-rule selection policy for the recently proposed visual generative learning approach AbdGen [Peng et al., 2023], aiming at significantly reducing the candidate meta-rule set and pruning the search space. The selection model is built based on the embedding representation of both symbol grounding of cases and meta-rules, which can be effectively integrated with both neural model and logic reasoning system. The pre-training process is done on pure symbol data, not involving symbol grounding learning of raw visual inputs, making the entire learning process low-cost. An additional interesting observation is that the selection policy can rectify symbol grounding errors unseen during pre-training, which is resulted from the memorization ability of attention mechanism and the relative stability of symbolic patterns. Experimental results show that our method is able to effectively address the meta-rule selection problem for visual abduction, boosting the efficiency of visual generative abductive learning. Code is available at https://github.com/future-item/metarule-select.

视觉生成逻辑推理元规则

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。