arXiv:2604.17301cs.CLcs.AI2026-04中稿 · SIGIR-ICTIR 2026, …

用生活经验规则增强大模型对话有害内容判断,更准确且省计算。

RoTRAG: Rule of Thumb Reasoning for Conversation Harm Detection with Retrieval-Augmented Generation

论文配图:RoTRAG: Rule of Thumb Reasoning for Conversation Harm Detection with Retrieval-Augmented Generation
图 1 · 摘自论文原文
  • 引入人类总结的道德准则(规则)作为外部依据,指导每轮对话判断。
  • 在多个数据集上比现有方法提升约40%的分类准确率,误判率降低8.4%。
  • 自动判断是否需新检索,减少重复计算,适合实际部署场景。

多轮对话中的有害内容检测需要基于完整对话上下文进行推理,而非孤立语句。但现有方法主要依赖模型内部参数化知识,缺乏外部规范性原则的显式支撑,常导致社会情境下判断不一致、可解释性差,且各轮推理重复冗余。为此,我们提出RoTRAG:一种融合外部简明道德准则(规则)的检索增强框架。对每轮对话,系统从外部语料中检索相关规则,并将其作为显式规范证据用于本轮推理与最终危害等级判定。为提升效率,进一步设计轻量级二分类路由模块,决定新轮次是否需检索推理或复用已有上下文。在ProsocialDialog与Safety Reasoning Multi Turn Dialogue数据集上的实验表明,RoTRAG在多项指标上持续优于基线,跨基准平均相对F1提升约40%,分布误差降低8.4%,同时减少冗余计算且不影响性能。

原文摘要 · Abstract (English)

Detecting harmful content in multi turn dialogue requires reasoning over the full conversational context rather than isolated utterances. However, most existing methods rely mainly on models internal parametric knowledge, without explicit grounding in external normative principles. This often leads to inconsistent judgments in socially nuanced contexts, limited interpretability, and redundant reasoning across turns. To address this, we propose RoTRAG, a retrieval augmented framework that incorporates concise human written moral norms, called Rules of Thumb (RoTs), into LLM based harm assessment. For each turn, RoTRAG retrieves relevant RoTs from an external corpus and uses them as explicit normative evidence for turn level reasoning and final severity classification. To improve efficiency, we further introduce a lightweight binary routing classifier that decides whether a new turn requires retrieval grounded reasoning or can reuse existing context. Experiments on ProsocialDialog and Safety Reasoning Multi Turn Dialogue show that RoTRAG consistently improves both harm classification and severity estimation over competitive baselines, with an average relative gain of around 40% in F1 across benchmark datasets and an average relative reduction of 8.4% in distributional error, while reducing redundant computation without sacrificing performance.

对话安全检索增强规则推理大模型评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。