让AI写论文时每一步都可追溯,必须经人审批
Paper Pilot: A Human-in-the-Loop Expert System for Evidence-Traceable Scientific Manuscript Generation in Applied Sciences

- 引入8个审批关卡,确保每条结论都有据可查
- 实验显示零伪造引用,漏洞自动标记为占位符
- 适合科研团队、期刊审稿人关注可信生成
大型语言模型(LLM)代理正被嵌入科学工作流中用于文献分析、起草与评审。现有系统虽推进了自主发现与论文生成,但未能解决思想、方法、结果与主张在AI辅助流程中传播时缺乏强制人类审批和证据级追溯的治理问题。本文提出Paper Pilot,一种面向应用科学领域的可证据追溯的科学论文生成人机协同专家系统。它采用协作代理推理工程(CARE)方法论,在论文开发中引入作者审批节点、明确不通过标准、主张分类、审计日志、顾问型LLM审查及证据锁定修订控制。框架定义了从想法到主张全链路的八个审批关卡,区分文献依据型与数据依据型主张,要求报告数值与解释必须可追溯至已批准证据;其系统提示已公开发布,可在ChatGPT、Gemini、Claude或机构内LLM环境中部署。初步实证验证显示,在引用可追溯性层面上,受控机械评分基准测试中(两商用LLM,真实arXiv论文,无LLM裁判):未设关卡的起草者在覆盖压力下最高伪造25%引用且从未标记证据缺口;而同一模型在Paper Pilot的证据锁定规则下,零伪造引用,并将预置缺口明确暴露为占位符。结果接地、修订与对抗鲁棒性的初步结果亦指向相同方向;完整评估留待后续工作。Paper Pilot将LLM辅助写作定位为受控的人机决策支持过程,而非完全自主的著述流水线。
原文摘要 · Abstract (English)
Large language model (LLM) agents are increasingly embedded in scientific workflows for literature analysis, drafting, and review. Existing systems advance autonomous discovery and manuscript generation, but do not resolve the governance problem that arises when ideas, methods, results, and claims propagate through AI-assisted workflows without mandatory human approval or artifact-level traceability. This paper proposes Paper Pilot, a human-in-the-loop expert system for evidence-traceable scientific manuscript generation in applied sciences. It adapts the Collaborative Agent Reasoning Engineering (CARE) methodology to manuscript development through manuscript-owner approval gates, explicit no-pass criteria, claim classification, audit logging, advisory LLM review, and evidence-locked revision control. The framework defines eight approval gates across the idea-to-claim pipeline and distinguishes literature-grounded from artifact-grounded claims, requiring reported numbers and interpretations to remain traceable to approved evidence; its system prompt is openly released for deployment in ChatGPT, Gemini, Claude, or institutional LLM environments. As a first empirical validation, we evaluate the citation-grounding layer with a controlled, mechanically scored benchmark (two commercial LLMs, real arXiv papers, no LLM judge): under coverage pressure ungated drafters fabricated up to 25% of their citations and never flagged an evidence gap, whereas the same models under Paper Pilot's evidence-locked rules produced zero fabricated citations and surfaced the planted gaps as explicit placeholders. Preliminary results for result grounding, revision, and adversarial robustness point the same way; full evaluation is left to future work. Paper Pilot positions LLM-assisted writing as a controlled human-AI decision-support process rather than a fully autonomous authorship pipeline.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。