arXiv:2606.09500cs.AIcs.DL2026-06被引 2

为医学论文生成设计可审计的确定性验证机制,防造假、保可复现。

Deterministic Integrity Gates for LLM-Assisted Clinical Manuscript Preparation: An Auditable Biomedical Informatics Architecture

论文配图:Deterministic Integrity Gates for LLM-Assisted Clinical Manuscript Preparation: An Auditable Biomedical Informatics Architecture
图 1 · 摘自论文原文
  • 分阶段拆解写作流程,每步用可重执行的确定性检查拦截风险
  • 在三个临床指南数据集上检测27个注入缺陷,100%准确无误报
  • 适合需要可审计、可复现的医学论文自动化系统开发者使用

随着自主研究代理和AI合作者将大语言模型(LLMs)从撰写推向端到端论文生成,瓶颈从生成转向验证。流畅的LLM输出可能隐藏伪造引用、与原始表格数据偏离的数值以及未满足的报告指南条目;现有工具仅生成不验证,自省也继承了导致自信伪造的盲区。本文提出一种生成与验证结合的架构,基于三大原则:将工作流分解为自包含技能、在每个阶段转移时设置失败即停的门控机制、对每个完整性问题采用最廉价充分的确定性检测——能用可重执行的确定性检查解决的绝不依赖自然语言判断。这一‘能确定则确定’的分离策略,组织成完整性门控分类法,是核心贡献。该架构实现为MedSci Skills,一个包含43个技能的开源工具包,其中21个为确定性检测器。在三个公开数据集管道(STARD, PRISMA, STROBE)和种子缺陷消融实验中,所有内容哈希验证通过且真实缺陷被成功暴露;在27个相同注入缺陷测试中,确定性门控全部检出且干净样本无误报,而单提示词LLM评审仅检出11个,漏检集中在代码、参考文献和风格类缺陷,这些正是自然语言难以察觉的。确定性优先的验证提供了可审计、可复现的证据链,向人类展示核查所需依据:可行性与可复现性证据,而非宣称达到人类水平质量(另一项盲评研究另作评估)。MedSci Skills采用MIT许可证并已归档(v3.8.0)。

原文摘要 · Abstract (English)

As autonomous research agents and AI co-scientist systems push large language models (LLMs) from drafting toward end-to-end manuscript production, the bottleneck shifts from generation to verification. Fluent LLM output can hide fabricated citations, numbers that drift from source tables, and unmet reporting-guideline items; existing tools generate without verifying, and self-critique inherits the blind spots that produce confident fabrication. We describe an architecture pairing generation with verification, resting on three principles: decompose the workflow into self-contained skills, gate every stage transition with halt-on-failure, and resolve each integrity question with the cheapest sufficient mechanism, a deterministic, re-executable check where one suffices and a prose-level probe only where interpretation is unavoidable. This determinism-where-possible split, organized as an integrity-gate taxonomy, is the core contribution. It is realized as MedSci Skills, an open-source toolkit of 43 skills with a 21-detector deterministic tier, evaluated on three public-dataset pipelines (STARD, PRISMA, STROBE) and a seeded-defect ablation. Across the three pipelines every content-hash manifest verified clean and the gates surfaced real defects; on 27 identical injected defects the deterministic gates detected all 27 with no false positives on the matched clean fixtures, whereas a single-prompt LLM reviewer detected 11, its misses in code, bibliography, and style defects the prose hides. Determinism-where-possible verification yields an auditable, re-executable trail that exposes the evidence a human needs to check an LLM-assisted manuscript: feasibility and reproducibility evidence, not a claim of human-competitive quality, which a separate blinded study addresses. MedSci Skills is MIT-licensed and archived (v3.8.0).

医学写作可审计性确定性验证LLM安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。