arXiv:2606.25701cs.CV2026-06中稿 · ECCV

让AI看X光行李时能识别组件间的危险组合,而非只盯单个物品。

Falcon: Functional Assembly and Language for Compositional Reasoning in X-ray

论文配图:Falcon: Functional Assembly and Language for Compositional Reasoning in X-ray
图 1 · 摘自论文原文
  • 用结构化状态表示部件存在、功能兼容性和整体风险
  • 在复杂X光图中提升功能定位与威胁判断准确率
  • 适合安检、安全审查等需要组合推理的场景

传统视觉语言模型以物体为中心,专注于检测和描述单一实体。但在安全关键的X光行李安检中,威胁往往并非来自单一物品,而是由空间分散的组件(如电池、引信和炸药)之间的功能兼容性所导致。我们将其形式化为‘组合威胁推理’,将风险视为接地区域间的关联属性,而非独立检测结果。提出Falcon多模态框架,将分割感知的区域特征抽象为结构化安全状态,包含组件存在性、成对功能兼容性及场景级风险。该结构化表示作为显式中间接口注入语言模型,促使关系一致且安全敏感的推理。为此构建Falcon-X基准,统一密集定位与组件完整性和风险推断的结构化标注。实验表明,现有模型虽能适应外观,却难以进行组合安全推理。Falcon显著提升功能定位能力,生成更连贯的威胁评估,确立组合安全推理作为多模态系统的新评估范式。

原文摘要 · Abstract (English)

Conventional vision-language models are largely object-centric, focusing on detecting and describing individual entities. In safety-critical X-ray baggage screening, however, threat often emerges not from a single object but from the functional compatibility of spatially dispersed components, such as batteries, detonators, and explosive charges. We formalize this setting as \emph{compositional threat reasoning}, where risk is modeled as a relational property of grounded regions rather than an independent detection outcome. We introduce \textbf{Falcon}, a multimodal framework that abstracts segmentation-aware region features into a structured safety state capturing component presence, pairwise functional compatibility, and scene-level risk. This structured representation is injected into the language model as an explicit intermediate interface, encouraging relationally consistent and safety-aware reasoning. To evaluate this problem, we present \textbf{Falcon-X}, a benchmark that unifies dense grounding with structured supervision over component completeness and risk inference in cluttered X-ray imagery. Experiments show that while existing multimodal models adapt to appearance, they struggle with compositional safety reasoning. Falcon improves functional grounding and produces more coherent threat assessments, establishing compositional safety reasoning as a distinct evaluation paradigm for multimodal systems.

X光安检组合推理多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。