用蒙特卡洛树搜索生成图文报告,让数据叙述更准确连贯。
Monte Carlo Tree Search for Table-to-Multimodal Report Generation

- 将报告生成拆解为可动态推理的原子动作,由大模型逐步执行。
- 在跨领域基准上达到77.9分,显著提升事实准确性与图表一致性。
- 适合需要高可靠多模态报告生成的研究者与工业应用。
从结构化表格自动生成包含文本分析与可视化图表的专业多模态报告,是数据智能中的关键挑战。现有方法受限于固定线性流程和孤立子任务处理,难以联合优化事实准确性、视觉质量与叙事连贯性。本文提出MCTS-Report,一种基于蒙特卡洛树搜索(MCTS)的框架,将多模态表到报告生成建模为在结构化搜索空间中的渐进式构建过程。核心思想是将报告生成分解为原子动作:章节规划、可视化任务识别、图表生成、洞察组织与叙事优化,每个动作由基于当前报告状态动态推理的大语言模型(LLM)执行。我们使用LLM在MCTS中生成逐步推理与动作,并将推理轨迹存储于每个节点,以实现上下文感知的连贯生成。为引导搜索,设计多维奖励函数,联合评估数值事实一致性(通过SQL)、图表质量、图表-文本对齐度与结构完整性,同时引入多样性惩罚抑制重复图表,并设置前置条件检查剔除无效动作。我们还构建了MMRBench,一个涵盖六个真实领域数据集的综合性基准,包含专家精修的参考报告结构与可验证的关键洞察。在MMRBench上的实验表明,MCTS-Report在结构完整性、数值准确性、图表-文本对齐度与洞察新颖性方面均显著优于强基线,综合得分达77.9。
原文摘要 · Abstract (English)
Automatically generating professional multimodal reports comprising both textual analysis and visual charts from structured tabular data is a critical challenge in data intelligence. Existing methods suffer from fixed linear pipelines and isolated subtask processing, which hinder joint optimization of factual accuracy, visual quality, and narrative coherence. To address these issues, this paper proposes MCTS-Report, a Monte Carlo Tree Search (MCTS)-driven framework that formulates multimodal table-to-report generation as a progressive construction process over a structured search space. The core idea is to decompose report generation into atomic actions, including chapter planning, visualization task identification, chart generation, insight organization, and narrative refinement, each executed by an LLM based on dynamic reasoning conditioned on the current report state. We use an LLM to generate step-by-step reasoning and actions during MCTS, storing the reasoning trajectory in each node for context-aware, coherent report construction. To guide the search, we design a multi-dimensional reward function that jointly evaluates numerical fact consistency (via SQL), chart quality, chart-text alignment, and structural completeness, while incorporating a diversity penalty to suppress repeated charts and a precondition check to prune invalid actions. We also construct MMRBench, a comprehensive benchmark comprising real-world tables from six domains, paired with expert-refined reference report structures and verifiable key insights. Experiments on MMRBench demonstrate that MCTS-Report significantly outperforms strong baselines across structural completeness, numerical accuracy, chart-text alignment, and insight novelty, achieving a 77.9 overall score.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。