MIDAS自动适配不同场景的摘要需求,无需人工调参。
MIDAS: Multi-LLM Iterative Data-Adaptive Summarization

- 多大模型协作学习数据模式,动态生成适配不同格式的摘要
- 在五种输出格式上提升ROUGE-1最高11.0%,ROUGE-2最高18.2%
- 适合企业级文档摘要,尤其需多格式输出的场景
文本摘要看似简单,实则复杂。企业级支持工单、法律文件、事件报告等摘要需严格遵守领域规范与格式要求,传统手工设计提示词成本高且难以维护。现有自动化方法依赖大模型批判式优化,但受限于静态提示词。本文提出多大模型迭代式数据自适应摘要框架MIDAS,通过数据驱动模式学习与场景个性化,实现无需人工干预的自动适配。在五种输出格式的企业客户工单摘要任务中,MIDAS性能优于CriSPO、ZERA等前沿框架,ROUGE-1最高提升11.0%,ROUGE-2最高提升18.2%,ROUGE-L最高提升8.0%,所有格式下BERTScore F1均提升。还验证了跨模型与跨领域泛化能力。
原文摘要 · Abstract (English)
Text summarization is deceptively difficult. While condensing information seems straightforward, real-world enterprise summarization of support tickets, legal documents, incident reports, and more, demands strict adherence to domain-specific guidelines, output formats, and organizational conventions. Crafting prompts that reliably satisfy these constraints is labor-intensive, requiring significant human expertise and continuous maintenance as requirements evolve. Existing automated prompt optimization methods reduce this burden through Large Language Model (LLM) critique-driven refinement, yet remain limited by static prompts that cannot adapt to the diversity of summary applications. We propose Multi-LLM Iterative Data-Adaptive Summarization (MIDAS), a multi-LLM framework that extends this paradigm with data-driven pattern learning and use-case-specific personalization, enabling automatic adaptation to different summarization requirements without manual prompt engineering. Applied to enterprise customer ticket summarization across five output formats, MIDAS achieves the strongest overall performance against state-of-the-art critique-driven optimization frameworks such as CriSPO and ZERA, improving ROUGE-1 by up to 11.0%, ROUGE-2 by up to 18.2%, and ROUGE-L by up to 8.0%, while consistently improving BERTScore F1 across all formats and output types. We additionally demonstrate cross-model and cross-domain generalization through multi-LLM configurations and finance-domain summarization benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。