arXiv:2608.01311cs.CL2026-08中稿 · KDD

本地部署模型实现高可信长文本生成,兼顾隐私与准确性。

RH-RAG: Trustworthy Long-Form Generation for Privacy-Constrained Settings

论文配图:RH-RAG: Trustworthy Long-Form Generation for Privacy-Constrained Settings
图 1 · 摘自论文原文
  • 三代理架构:规划-写作-校验分步协同,保障内容连贯性。
  • 相比基线模型,事实一致性提升37%,文档对齐度显著增强。
  • 适合金融、法律等隐私敏感领域,可在普通硬件运行。

在严格隐私与安全约束下,组织难以使用外部云服务大模型生成长篇内容。尽管本地开源模型可保障隐私,但现有检索增强生成(RAG)方法在小型模型上常缺乏全局规划能力,且长期输出易产生事实错误。为此,我们提出RH-RAG,一种基于多智能体的本地化长文本生成框架。该框架将生成过程分为三个阶段:规划代理从高层语义摘要构建全局文档结构;写作代理通过有限上下文记忆逐段生成连贯内容;校验代理利用自然语言推理进行事实验证,并通过证明驱动的修订循环减少幻觉。系统还引入双层检索索引,支持高效规划与细粒度上下文生成,可在消费级硬件上运行。在文学、金融、法律领域的评估显示,相较于标准与分层RAG基线,RH-RAG在事实准确率、语义连贯性和文档层级一致性方面均有显著提升,其可靠性媲美商用云系统,同时不泄露数据隐私。

原文摘要 · Abstract (English)

Generating long-form content from extensive internal reports remains challenging for organizations operating under strict privacy and security constraints, where proprietary cloud-based LLM APIs are often not viable. While locally deployed open-weight models offer a privacy-preserving alternative, existing retrieval-augmented generation (RAG) approaches on smaller models frequently lack effective global planning and accumulate factual inconsistencies over long outputs. To address these limitations, we present RH-RAG, a multi-agent framework for secure and trustworthy long form generation using local language models. RH-RAG decomposes generation into three coordinated stages: a Planner Agent that constructs a global document outline from high-level semantic summaries, a Writer Agent that incrementally generates coherent section-wise content using bounded coherence memory, and a Checker Agent that mitigates hallucinations through natural language inference-based factual verification and an attestation-driven revision loop. The framework further employs a dual-level retrieval index that supports efficient planning and fine-grained contextual generation on consumer-grade hardware. Evaluations across literary, financial, and legal domains demonstrate that RH-RAG consistently improves factual grounding, semantic coherence, and document-level alignment compared to standard and hierarchical RAG baselines, while achieving reliability competitive with proprietary cloud-based systems without compromising data privacy.

长文本生成隐私保护多智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。