arXiv:2608.29865cs.CL2026-08中稿 · Findings of the As…

让AI主动找漫画线索,精准回答跨格叙事问题。

ManGo: Manga Active Narrative Grounding Optimization

论文配图:ManGo: Manga Active Narrative Grounding Optimization
图 1 · 摘自论文原文
  • 通过迭代选格、提取关键线索、判断停止时机,构建问题导向的证据草图。
  • 在无标注数据下实现顶尖性能,跨多个基准测试均优于现有方法。
  • 适合研究漫画理解、视觉推理与主动学习的学者和开发者。

漫画视觉问答要求模型基于分格呈现的视觉叙事回答问题,相关证据分散于有序面板、嵌入文本、重复角色及隐含事件转换中。这种结构使被动页面编码不足,模型需主动识别应检查的面板、保留哪些线索,并判断累积证据是否足够作答。我们提出ManGo(Manga Active Narrative Grounding Optimization),一种无监督的主动漫画视觉问答框架。ManGo引入主动叙事草图(ANS),通过迭代选择面板、提取简洁的有根据线索并决定停止时机,在生成答案前形成紧凑的问题导向证据草图。为在无人类标注答案或推理路径的情况下优化该行为,ManGo采样多条ANS轨迹,采用组相对训练结合两项奖励:来自列表式自排名的答案偏好,以及来自稳定有序面板轨迹的路径一致性。联合奖励通过组相对策略训练进行优化,促使模型同时提升最终答案与支撑它们的面板级证据路径。在标准漫画理解基准上的实验表明,ManGo在不同设置下均达到当前最优性能。

原文摘要 · Abstract (English)

Manga visual question answering requires models to answer questions over panel-based visual narratives, where relevant evidence is distributed across ordered panels, embedded text, recurring characters, and implicit event transitions. This structure makes passive page encoding insufficient, as the model must identify which panels to inspect, what clues to retain, and when the accumulated evidence is sufficient for answering. We propose ManGo (Manga Active Narrative Grounding Optimization), an unsupervised framework for active manga visual question answering. ManGo introduces Active Narrative Sketching (ANS), which iteratively selects panels, extracts concise grounded clues, and decides when to stop, forming a compact question-directed evidence sketch before answer generation. To optimize this behavior without human-annotated answers or rationale paths, ManGo samples multiple ANS rollouts and applies group-relative training with two rewards: answer preference from listwise self-ranking and path consistency from stable ordered panel trajectories. The combined reward is optimized with group-relative policy training, encouraging the model to improve both final answers and the panel-level evidence paths that support them. Experiments on standard manga understanding benchmarks show that ManGo achieves state-of-the-art performance across different settings.

漫画理解视觉问答主动推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。