arXiv:2607.00870cs.CL2026-07

在临床NLP中,通过动态记忆过滤无效提取,提升验证效率。

Dynamic Bidirectional Pattern Memory: A Production-Scale Empirical Characterisation of Inference-Time Gating in Clinical NLP

  • 用轻量记忆学习部署时过滤规则,避免重复验证失败项。
  • 基于临床术语库的固定规则可捕获近5万条违规关系,效果稳定。
  • 过滤器必须检验验证器所关注的证据,才能有效筛选答案。

我们在生产级临床NLP流水线中研究推理时的模式记忆门控。该系统使用生成器(Llama-3.3 70B)提出抽取内容,验证器(MMed-Llama-3.1 70B)决定接受或拒绝,覆盖167,034份PMC-Patients病历文本,并引入轻量级记忆模块,在部署时学习过滤已知失败的抽取项,使验证器无需重新检查。研究发现:第一,直接从验证器拒绝中学习过滤规则在全规模下失效,尽管记录了785,797次拒绝,但因形式分散而无法积累;第二,使用固定临床本体的简单规则无需验证器即可实现相同过滤,捕获49,734条本体违规关系;第三,五个问答过滤版本中四个失败,第五个通过检查抽取实体是否支持问题,其对验证器将拒答案的标记概率是接受答案的1.84倍;第四,所有成功过滤均依赖于测试与验证器相同的证据,而非模仿其输出。系统始终标记可疑抽取而非删除,确保每一步可审计。代码与测试数据均已开源。

原文摘要 · Abstract (English)

We study inference-time pattern-memory gating in a production-scale clinical natural language processing (NLP) pipeline. The pipeline pairs a generator (Llama-3.3 70B) proposing extractions with a verifier (MMed-Llama-3.1 70B) accepting or rejecting them, over 167,034 PMC-Patients narratives, and adds a lightweight memory that learns at deployment which extractions to filter, so the verifier need not re-examine candidates already seen to fail. We report four findings. First, learning filtering rules directly from the verifier's rejections failed at full scale: the relation-extraction filter stayed empty despite 785,797 logged rejections, because they were spread too thinly across too many distinct forms to accumulate. Second, a simpler rule using a fixed clinical ontology produced the same filtering without the verifier, capturing 49,734 ontology-violating relations on a held-out 5,000-patient set. Third, of five versions of the question-answering filter, four failed for distinct, instructive reasons; the fifth succeeded by checking whether a patient's extracted entities support the question asked, and where it applies was 1.84 times likelier to flag an answer the verifier would reject than one it would accept. Fourth, one pattern held across all five: a filter is selective only when it tests the same evidence the verifier weighs, not when it imitates the verifier's output. Together these give a transferable result for any generator-verifier pipeline: the most natural memory design can fail silently at scale, and whether a pre-generation gate is selective is decided before any engineering effort, by whether its signal probes the question the verifier itself answers. Throughout, the system flags suspect extractions rather than deleting them, so every decision stays visible for clinical review. All code and test artefacts are released openly.

临床NLP生成验证模式记忆推理优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。