arXiv:2509.08621cs.CV2025-09ICCV被引 13

用广告视频测试大模型的深层理解能力,突破纯视觉认知边界。

AdsQA: Towards Advertisement Video Understanding

  • 构建广告视频问答基准AdsQA,含1.5万段视频片段,覆盖5类高阶任务。
  • 提出ReAd-R模型,通过奖励驱动优化实现深度反思式回答生成。
  • 在14个顶级大模型中,ReAd-R以显著优势领先,尤其擅长逻辑推理与说服策略分析。

大语言模型(LLMs)正迈向通用人工智能(AGI)。随着数学、编程等特定领域问题推动模型持续深化专业能力,拓展知识型大模型的应用多样性已成为关键。本文提出以广告视频为挑战性测试场景,评估大模型超越客观视觉内容的深层理解能力。广告视频具有线索丰富、信息密集的特点,蕴含营销逻辑、说服策略与受众互动机制。我们的贡献有三:(1)首次将广告视频与精心设计的任务结合用于评测大模型,构建了基于1,544个广告视频、共10,962个片段(总计22.7小时)的AdsQA基准,涵盖5类挑战性任务;(2)提出受Deepseek-R1启发的强化学习模型ReAd-R,通过反思问题并基于奖励优化生成答案;(3)在AdsQA上对14个顶尖大模型进行基准测试,结果表明,ReAd-R显著优于具备长链推理能力的强基线模型,达到当前最佳性能。

原文摘要 · Abstract (English)

Large language models (LLMs) have taken a great step towards AGI. Meanwhile, an increasing number of domain-specific problems such as math and programming boost these general-purpose models to continuously evolve via learning deeper expertise. Now is thus the time further to extend the diversity of specialized applications for knowledgeable LLMs, though collecting high quality data with unexpected and informative tasks is challenging. In this paper, we propose to use advertisement (ad) videos as a challenging test-bed to probe the ability of LLMs in perceiving beyond the objective physical content of common visual domain. Our motivation is to take full advantage of the clue-rich and information-dense ad videos' traits, e.g., marketing logic, persuasive strategies, and audience engagement. Our contribution is three-fold: (1) To our knowledge, this is the first attempt to use ad videos with well-designed tasks to evaluate LLMs. We contribute AdsQA, a challenging ad Video QA benchmark derived from 1,544 ad videos with 10,962 clips, totaling 22.7 hours, providing 5 challenging tasks. (2) We propose ReAd-R, a Deepseek-R1 styled RL model that reflects on questions, and generates answers via reward-driven optimization. (3) We benchmark 14 top-tier LLMs on AdsQA, and our \texttt{ReAd-R}~achieves the state-of-the-art outperforming strong competitors equipped with long-chain reasoning capabilities by a clear margin.

广告理解大模型评测强化学习视频问答

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。