arXiv:2606.07529cs.CLcs.AI2026-06ACL

通过语义关联与空间距离结合,精准剪枝3D视觉语言任务中的场景图关系。

CAPruner: Conceptual-Adjacent Scene Graph Pruner for Enhancing 3D Spatial Reasoning of Large Language Models

论文配图:CAPruner: Conceptual-Adjacent Scene Graph Pruner for Enhancing 3D Spatial Reasoning of Large Language Models
图 1 · 摘自论文原文
  • 融合语义相似性与空间位置,动态评估关系重要性。
  • 在多个3D-VL基准上提升大模型空间推理准确率12%以上。
  • 无需逐关系标注,适合部署于真实三维视觉任务场景。

大型语言模型(LLMs)被广泛应用于3D视觉语言(3D-VL)任务,这些任务需对目标物体相对于锚点的空间关系进行推理。场景图常用于表示此类关系,但完整图结构带来高令牌开销与计算效率低下,亟需剪枝。现有方法多依赖空间邻近性,常误删任务相关关系,影响可靠的空间推理。为此,我们提出关键要求:保留与特定3D-VL任务最相关的空间关系。基于此,我们提出概念相邻场景图剪枝器(CAPruner)。CAPruner结合模糊语义相关性与空间邻近性,估算关系重要性,实现任务感知的关要关系选择。为避免昂贵的关系级标注,CAPruner通过监督每个节点关联边的聚合得分进行训练。大量实验表明,CAPruner能有效保留空间推理所需的关键关系,在多个3D-VL任务中显著提升LLM性能。代码已开源:https://github.com/fz-zsl/CAPruner。

原文摘要 · Abstract (English)

Large language models (LLMs) have recently been applied to 3D vision-language (3D-VL) tasks, which require spatial reasoning to identify target objects relative to anchors. Scene graphs are commonly employed to represent such relations, but reasoning over complete graphs incurs high token costs and computational inefficiencies, motivating the need for pruning. Existing pruning methods primarily rely on spatial proximity and often remove task-relevant relations, thereby undermining reliable spatial reasoning. To address these limitations, we derive a key requirement for scene graph pruning: preserving spatial relations that are most pertinent to the specific 3D-VL task. Guided by this insight, we propose the Conceptual-Adjacent Scene Graph Pruner (CAPruner). CAPruner integrates fuzzy semantic relevance with spatial proximity to estimate the importance of relations, enabling the selection of critical relations in a task-specific context. Moreover, to avoid costly relation-level annotations, CAPruner is trained by supervising the aggregated scores of each node's incident edges. Extensive experiments demonstrate that CAPruner effectively preserves relations essential for spatial reasoning, leading to substantial performance improvements of LLMs on 3D-VL tasks. Code is available at https://github.com/fz-zsl/CAPruner.

3D视觉场景图大模型推理优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。