让摘要忠实呈现观点分歧,避免大模型掩盖少数意见。
Faithful Summarisation under Disagreement via Belief-Level Aggregation
- 先提取文档中的观点集合,再用距离度量融合冲突观点
- 在多个模型上验证,小模型也能稳定生成有分歧的摘要
- 适合需要真实反映争议场景的应用,如舆情分析
观点性多文档摘要常涉及真实分歧,但现有基于大模型的方法往往隐式平滑矛盾,过度代表多数观点,影响摘要忠实度。本文提出一种分歧感知的合成流程,将观点级聚合与语言生成分离:先将文档表示为结构化观点集,使用基于距离的聚合算子显式建模冲突;再用大模型将聚合后观点转化为自然语言。在多种模型架构和规模上评估,结果表明:仅当聚合发生在生成阶段时,足够大的模型可达到观点聚合效果,但该行为在不同架构和容量下不稳定;而观点级聚合结合简单提示,能在各类模型上保持一致的分歧感知性能,同时生成流畅且事实可靠的摘要。
原文摘要 · Abstract (English)
Opinion and multi-document summarisation often involve genuinely conflicting viewpoints, yet many existing approaches, particularly LLM-based systems, implicitly smooth disagreement and over-represent majority opinions. This limits the faithfulness of generated summaries in opinion-heavy settings. We introduce a disagreement-aware synthesis pipeline that separates belief-level aggregation from language generation. Documents are first represented as structured belief sets and aggregated using distance-based belief merging operators that explicitly model conflict. Large language models are then used only to realise the aggregated beliefs as natural language summaries. We evaluate the approach across multiple model families and scales, comparing it to methods that perform explicit aggregation during generation. Our results show that while sufficiently large models can match belief-level aggregation when aggregation is handled at generation time, this behaviour is not stable across architectures or capacities. In contrast, belief-level aggregation combined with simple prompting yields consistently strong disagreement-aware performance across models, while maintaining fluent and grounded summaries.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。