基于多关系图与结构熵最小化的无监督摘要框架,自动聚类并生成高质量摘要。
MRGSEM-Sum: An Unsupervised Multi-document Summarization Framework based on Multi-Relational Graphs and Structural Entropy Minimization
- 构建融合语义与话语关系的多关系图,全面建模跨文档句子关联
- 通过二维结构熵最小化自动确定最优聚类数,有效减少冗余信息
- 引入位置感知压缩机制,生成简洁且覆盖全面的摘要,适合无标注场景
多文档摘要的核心挑战在于文档间关系的复杂性及信息冗余。图聚类是解决该问题的有效范式,通过图结构建模文档间复杂关系,并借助聚类减少冗余,已取得显著进展。然而,现有方法通常仅考虑单关系图,且需预先设定聚类数量,难以充分表达丰富的关系信息,也难以自适应地划分句子组以降低冗余。为此,我们提出MRGSEM-Sum,一种基于多关系图与结构熵最小化的无监督多文档摘要框架。具体而言,我们构建一个整合句子间语义与话语关系的多关系图,全面建模跨文档句子间的复杂动态连接。随后,应用二维结构熵最小化算法进行聚类,自动确定最优聚类数,有效将句子组织为连贯群组。最后,引入位置感知压缩机制,提炼每个聚类内容,生成简洁且信息丰富的摘要。在Multi-News、DUC-2004、PubMed和WikiSum四个基准数据集上的大量实验表明,该方法持续优于以往无监督方法,在部分情况下性能可媲美有监督模型与大语言模型。人工评估显示,MRGSEM-Sum生成的摘要具高一致性与覆盖率,接近人类水平。
原文摘要 · Abstract (English)
The core challenge faced by multi-document summarization is the complexity of relationships among documents and the presence of information redundancy. Graph clustering is an effective paradigm for addressing this issue, as it models the complex relationships among documents using graph structures and reduces information redundancy through clustering, achieving significant research progress. However, existing methods often only consider single-relational graphs and require a predefined number of clusters, which hinders their ability to fully represent rich relational information and adaptively partition sentence groups to reduce redundancy. To overcome these limitations, we propose MRGSEM-Sum, an unsupervised multi-document summarization framework based on multi-relational graphs and structural entropy minimization. Specifically, we construct a multi-relational graph that integrates semantic and discourse relations between sentences, comprehensively modeling the intricate and dynamic connections among sentences across documents. We then apply a two-dimensional structural entropy minimization algorithm for clustering, automatically determining the optimal number of clusters and effectively organizing sentences into coherent groups. Finally, we introduce a position-aware compression mechanism to distill each cluster, generating concise and informative summaries. Extensive experiments on four benchmark datasets (Multi-News, DUC-2004, PubMed, and WikiSum) demonstrate that our approach consistently outperforms previous unsupervised methods and, in several cases, achieves performance comparable to supervised models and large language models. Human evaluation demonstrates that the summaries generated by MRGSEM-Sum exhibit high consistency and coverage, approaching human-level quality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。