arXiv:2603.14997cs.CLcs.AI2026-03被引 1

用多智能体模拟生成可验证的企业数据,避免大模型幻觉。

OrgForge: A Multi-Agent Simulation Framework for Verifiable Synthetic Corporate Corpora

  • 用确定性引擎+大模型分工,确保文档生成有真实事件依据。
  • 在10个故障案例中,生成内容与真实事件一致性提升0.46。
  • 适合做企业AI训练数据、系统测试和幻觉研究的工程师。

构建和评估企业级AI系统需要内部一致、时间结构清晰且跨文档可追溯的合成组织语料库。现有语料库要么受法律约束,要么继承大模型生成的幻觉错误,当文档间时间戳或事实冲突时,会悄然污染结果并在训练中强化错误。我们提出OrgForge,一个开源的多智能体仿真框架,严格划分物理-认知边界:由确定性Python引擎维护模拟事件的唯一真实日志,大模型仅生成表面文本。框架模拟文档产生的组织流程,而非直接生成文档。工程师中途退出会触发事件交接与客户关系管理(CRM)权责缺失;系统未文档化时知识空缺自然出现,通过有机文档与故障修复逐步补全。客户邮件仅在仿真状态允许时触发,沉默也是可验证的真实状态。一个实时的CRM状态机将物理-认知边界扩展至客户层面,产生跨系统的因果链,涵盖工程事件、支持升级、交易风险标记和按服务等级协议调整的发票。框架生成15类交错的语料类型,均可追溯至共享的不可变事件日志。四个图动态子系统独立于任何大模型运行。基于嵌入的工单分配系统采用匈牙利算法,使仿真具备领域无关性。在10个故障案例上的实证评估显示,相比链式大模型基线,生成内容与真实事件的一致性提升0.46,并揭示了一种持续传播虚构事实的典型幻觉失效模式。

原文摘要 · Abstract (English)

Building and evaluating enterprise AI systems requires synthetic organizational corpora that are internally consistent, temporally structured, and cross-artifact traceable. Existing corpora either carry legal constraints or inherit hallucination artifacts from the generating LLMs, silently corrupting results when timestamps or facts contradict across documents and reinforcing those errors during training. We present OrgForge, an open-source multi-agent simulation framework that enforces a strict physics-cognition boundary: a deterministic Python engine maintains a SimEvent ground-truth bus while LLMs generate only surface prose. OrgForge simulates the organizational processes that produce documents, not the documents themselves. Engineers leave mid-sprint, triggering incident handoffs and CRM ownership lapses. Knowledge gaps emerge when under-documented systems break and recover through organic documentation and incident resolution. Customer emails fire only when simulation state warrants contact; silence is verifiable ground truth. A live CRM state machine extends the physics-cognition boundary to the customer boundary, producing cross-system causal cascades spanning engineering incidents, support escalation, deal risk flagging, and SLA-adjusted invoices. The framework generates fifteen interleaved artifact categories traceable to a shared immutable event log. Four graph-dynamic subsystems govern organizational behavior independently of any LLM. An embedding-based ticket assignment system using the Hungarian algorithm makes the simulation domain-agnostic. An empirical evaluation across ten incidents demonstrates a 0.46 absolute improvement in prose-to-ground-truth fidelity over chained LLM baselines, and isolates a consistent hallucination failure mode in which chaining propagates fabricated facts faithfully across documents without correcting them.

多智能体企业数据幻觉检测仿真框架

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。