用多智能体协作框架,通过自然语言交互降低大模型幻觉。
Hallucination Mitigation using Agentic AI Natural Language-Based Frameworks
- 设计三层智能体流水线,逐级审查并修正幻觉内容。
- 引入300+诱导幻觉的提示,使幻觉检测准确率提升显著。
- 基于NLP的统一接口实现上下文传递,适合高可信AI系统研发者。
当前生成式AI模型中的幻觉问题严重削弱了系统可信度。本研究探索通过协调多个专业化人工智能智能体来缓解该问题,重点利用自然语言处理(NLP)技术实现智能体间无缝交互。我们设计了一条流程:在前端智能体中注入超过300个精心构造的提示以诱发幻觉,随后由第二、第三层智能体分别使用不同的大语言模型和定制策略,检测未经证实的声明、添加明确免责声明并澄清推测性内容。此外,我们提出一组新型关键绩效指标(KPIs),专门用于评估幻觉得分水平。第四层专用智能体负责评估这些KPIs,提供详细反馈并确保幻觉行为变化的精准量化。核心组件为OVON(Open Voice Network)框架,基于通用NLP接口在智能体间传递上下文信息。通过结构化JSON消息,各智能体可传达幻觉可能性及其依据,使后续阶段能在不丢失上下文的前提下优化文本。实验表明,采用可互操作的NLP驱动智能体框架,能有效缓解幻觉问题,增强人工智能领域的信任度。
原文摘要 · Abstract (English)
Hallucinations remain a significant challenge in current Generative AI models, undermining trust in AI systems and their reliability. This study investigates how orchestrating multiple specialized Artificial Intelligent Agents can help mitigate such hallucinations, with a focus on systems leveraging Natural Language Processing (NLP) to facilitate seamless agent interactions. To achieve this, we design a pipeline that introduces over three hundred prompts, purposefully crafted to induce hallucinations, into a front-end agent. The outputs are then systematically reviewed and refined by second- and third-level agents, each employing distinct large language models and tailored strategies to detect unverified claims, incorporate explicit disclaimers, and clarify speculative content. Additionally, we introduce a set of novel Key Performance Indicators (KPIs) specifically designed to evaluate hallucination score levels. A dedicated fourth-level AI agent is employed to evaluate these KPIs, providing detailed assessments and ensuring accurate quantification of shifts in hallucination-related behaviors. A core component of this investigation is the use of the OVON (Open Voice Network) framework, which relies on universal NLP-based interfaces to transfer contextual information among agents. Through structured JSON messages, each agent communicates its assessment of the hallucination likelihood and the reasons underlying questionable content, thereby enabling the subsequent stage to refine the text without losing context. The results demonstrate that employing multiple specialized agents capable of interoperating with each other through NLP-based agentic frameworks can yield promising outcomes in hallucination mitigation, ultimately bolstering trust within the AI community.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。