arXiv:2506.16129cs.CV2025-06被引 3

让模型从全局标签中自动识别物体并推理逻辑规则,无需标注每个物体。

Neurosymbolic Object-Centric Learning with Distant Supervision

  • 用槽式编码器+概率逻辑层联合学习物体与规则
  • 在无物体标注下实现任务级可微训练,准确率超基准模型
  • 适合需要泛化到新组合、新数量和新规则的视觉推理场景

神经符号学习可利用符号规则为弱标签中的隐含概念提供监督,但通常假设规则中引用的实体已知。物体中心模型将图像分解为类似槽的表示,但这些槽未必与符号推理所需的谓词对齐。本文研究在远距离监督下的物体中心神经符号学习,即仅通过全局任务标签直接从图像中学习逻辑程序中的对象级参数。提出DeepObjectLog,一个融合槽式感知编码器与概率逻辑层的神经符号模型。编码器预测候选物体表示的物体存在度和类别概率,逻辑层对潜在的物体存在与类别分配进行边缘化,计算观测标签的可能性。该框架为物体中心感知提供了可微的任务级学习信号,无需每对象标签、掩码、边界框或启发式集合匹配。在多种视觉推理任务上的评估表明,DeepObjectLog在组合、物体计数和规则变化等分布外场景下的泛化能力优于神经物体中心与标准神经符号基线。

原文摘要 · Abstract (English)

Neurosymbolic learning can use symbolic rules to provide supervision for latent concepts from weak labels, but it commonly assumes that the entities referenced by these rules are already specified. Object-centric models decompose images into slot-like representations; however, such slots are not necessarily aligned with the predicates required for symbolic reasoning. We investigate object-centric neurosymbolic learning under distant supervision, where the object-level arguments of a logic program are learned directly from images using only global task labels. We introduce DeepObjectLog, a probabilistic neurosymbolic model that integrates a slot-based perceptual encoder with a probabilistic logic layer. The encoder predicts objectness and class probabilities for candidate object representations, while the logic layer marginalizes over latent objectness and class assignments to compute the likelihood of the observed label. This formulation provides a differentiable task-level learning signal for object-centric perception without requiring per-object labels, masks, bounding boxes, or heuristic set matching. Evaluations across diverse visual reasoning tasks demonstrate that DeepObjectLog achieves superior out-of-distribution generalization to compositional, object-count, and rule shifts compared to neural object-centric and standard neurosymbolic baselines.

神经符号物体中心弱监督视觉推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。