arXiv:2606.01936cs.CL2026-06

提出文档格式化新基准与工作流,提升内容感知下的格式准确率

What to Format and How: A Benchmark and Workflow Approach for Document Formatting

论文配图:What to Format and How: A Benchmark and Workflow Approach for Document Formatting
图 1 · 摘自论文原文
  • 将格式化任务拆解为‘做什么’和‘怎么做’两步,减少重复读取文档
  • 在多模型测试中,准确率提升且令牌消耗降低30%以上
  • 适合需要智能文档处理的研究者与开发者使用

大语言模型的发展为自动化文档格式化带来了新可能。然而,真实场景中的格式化常需根据内容识别目标,这种内容感知的设定仍具挑战性,主要因缺乏专用评估数据集。为此,我们提出了DocFormBench,一个扩展了Text-to-Format评估的基准,涵盖多样化的格式需求,并提供准确率与效率双指标。为缓解现有方法在格式化过程中冗余读取文档的问题,我们提出DocFormFlow,一种将目标定位与修改执行解耦的工作流方法。在多个LLM及多模态模型上的大量实验表明,DocFormFlow在保持或提升格式化准确率的同时,显著降低令牌消耗。进一步分析显示,精准的目标定位是影响格式化性能的关键因素。我们希望DocFormBench与DocFormFlow能推动更智能、可靠的文档格式化研究。

原文摘要 · Abstract (English)

Recent advances in large language models (LLMs) have opened up new possibilities for automated document formatting. However, real-world formatting often requires identifying targets based on document content. This content-aware setting remains challenging and underexplored, primarily due to the lack of dedicated evaluation datasets.To enable evaluation in realistic content-aware scenarios, we introduce DocFormBench, a benchmark that extends Text-to-Format evaluation to diverse formatting requirements, along with metrics for both accuracy and efficiency.To mitigate redundant document reading in existing methods during formatting, we propose DocFormFlow, a workflow formatting method that decouples target localization from modification execution into what to format and how. Extensive experiments across multiple LLMs and multimodal models show that DocFormFlow consistently improves formatting accuracy while reducing token consumption compared to representative baselines. Further analysis reveals that precise target localization is the primary factor influencing formatting performance. We hope DocFormBench and DocFormFlow will facilitate future research toward more intelligent and reliable document formatting.

文档格式化大模型应用工作流设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。