用树状结构分步推理,提升足球视频理解准确率
TreeSoc: Tree-Structured Dynamic Reasoning and Tool Synergy for Soccer Video Understanding

- 将复杂问题拆解为有序子任务,动态递归推理
- 在SoccerBench上达85.2%(TextQA)、87.4%(ImageQA)和82.2%(VideoQA)
- 支持工具协同,适合需要多步推理的视频理解场景
当前视觉语言模型在自动理解复杂足球场景时仍面临挑战,主要源于浅层跨模态对齐及多步推理与工具协同能力不足。本文提出TreeSoc,一种结构化推理框架,将足球视频问答重构为层次化搜索问题而非单次预测。TreeSoc采用动态深度优先搜索机制,将复杂查询分解为有序子任务,通过显式中间状态实现迭代推理优化。该树状结构自然支持自适应工具路由,域特定模块在每个推理节点被选择性激活并融合输出,生成上下文相关的预测。在SoccerBench上,TreeSoc取得85.2%(TextQA)、87.4%(ImageQA)和82.2%(VideoQA)的准确率。此外,其跨域泛化能力强,在NExT-QA上达到74.16%准确率。结果表明,结构化、工具增强的树形推理是鲁棒视频理解的有效范式。代码已开源。
原文摘要 · Abstract (English)
Automated understanding of complex soccer scenarios from video remains a significant challenge for contemporary vision-language models (VLMs), which suffer from shallow cross-modal alignment and exhibit fundamental limitations in multi-step reasoning and coordinated tool integration. We present TreeSoc, a structured reasoning framework that reformulates soccer video question answering as a hierarchical search problem rather than a single-pass prediction. Specifically, TreeSoc employs a dynamic depth-first search (DFS) mechanism that decomposes complex queries into sequentially ordered sub-tasks, enabling iterative reasoning refinement through explicit intermediate states. This tree-structured decomposition naturally supports adaptive tool routing, wherein domain-specific modules are selectively activated and their outputs incorporated at each reasoning node to produce contextually grounded predictions. On SoccerBench, TreeSoc achieves state-of-the-art performance, with accuracies of 85.2%, 87.4%, and 82.2% on TextQA, ImageQA, and VideoQA, respectively. Additionally, TreeSoc further demonstrates strong cross-domain generalization, attaining 74.16% accuracy on NExT-QA. These results establish structured, tool-augmented tree reasoning as an effective paradigm for robust video understanding. Code is available at: https://github.com/thanhnhan29/TreeSoc.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。