arXiv:2511.04956cs.AIcs.CL2025-11被引 1

ORCHID用AI+人工协作提升核能设施高风险物品分类的准确与可审计性

ORCHID: Orchestrated Retrieval-Augmented Classification with Human-in-the-Loop Intelligent Decision-Making for High-Risk Property

  • 分步式智能体协同检索与生成,实现政策驱动的分类决策
  • 实测准确率高于非智能体基线,不确定项自动转交专家
  • 适合需要可追溯合规流程的政府/能源机构使用

高风险物品(HRP)分类对美国能源部(DOE)站点至关重要,其库存包含敏感且常具双重用途的设备。合规需追踪各出口管制政策下的动态规则,以确保决策透明可审计。传统纯人工流程耗时、积压严重,难以应对监管边界变化。我们演示了ORCHID系统——一种模块化智能体架构,结合检索增强生成(RAG)与人工监督,输出可审计的政策依据结果。多个小型协作智能体(检索、描述精炼、分类、验证、反馈记录)通过智能体间通信协调,并利用模型上下文协议(MCP)调用工具,支持无需依赖特定模型的本地部署。系统遵循“物品→证据→决策”循环,具备逐步推理、在政策引用和追加式审计包(运行卡片、提示、证据)功能。初步测试中,针对真实HRP案例,ORCHID在准确率与可追溯性上优于非智能体基线,同时将不确定项自动转交领域专家(SME)。演示展示单个物品提交、基于证据的引用、专家反馈采集及可导出的审计文件,为可信大模型辅助在敏感能源合规工作流中的落地提供可行路径。

原文摘要 · Abstract (English)

High-Risk Property (HRP) classification is critical at U.S. Department of Energy (DOE) sites, where inventories include sensitive and often dual-use equipment. Compliance must track evolving rules designated by various export control policies to make transparent and auditable decisions. Traditional expert-only workflows are time-consuming, backlog-prone, and struggle to keep pace with shifting regulatory boundaries. We demo ORCHID, a modular agentic system for HRP classification that pairs retrieval-augmented generation (RAG) with human oversight to produce policy-based outputs that can be audited. Small cooperating agents, retrieval, description refiner, classifier, validator, and feedback logger, coordinate via agent-to-agent messaging and invoke tools through the Model Context Protocol (MCP) for model-agnostic on-premise operation. The interface follows an Item to Evidence to Decision loop with step-by-step reasoning, on-policy citations, and append-only audit bundles (run-cards, prompts, evidence). In preliminary tests on real HRP cases, ORCHID improves accuracy and traceability over a non-agentic baseline while deferring uncertain items to Subject Matter Experts (SMEs). The demonstration shows single item submission, grounded citations, SME feedback capture, and exportable audit artifacts, illustrating a practical path to trustworthy LLM assistance in sensitive DOE compliance workflows.

AI合规智能体系统可审计决策政策分类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。