将临床随访指令拆解为动作与时间,提升医疗文本抽取准确率。
Reliable Extraction of Clinical Follow-Up Instructions: A Hybrid Neural-Symbolic Pipeline
- 先用神经网络识别动作和时间,再用规则确定具体日期。
- 在259条测试数据上,配对准确率达99.7%,误差仅0.00天。
- 适合医疗信息抽取、电子病历分析等需要高精度的场景。
门诊记录中常包含行动与时间的组合指令(如“两周后做脑部MRI”),提取(动作,日期)对有助于排程与审计。但生成式模型因隐式依赖链接与算术计算而常漏掉日期。本文提出一种混合神经符号管道:定义测试与时间实体及调度关系,使用BioBERT进行标注与链接,通过28类动作本体规范动作,以确定性方式将时间转为天数偏移。在2000条合成门诊笔记数据集上评估,采用动作不重叠划分(18类训练,6类未见测试),对比零样本GPT-4o-mini与微调后的LLaMA-3 8B(note-level bootstrap 95% CI)。结果表明,该混合管道在259条已见与未见测试集上分别达到0.997与0.986的测试时配对F1,MAE为0.00天;基线模型动作F1较高(LLaMA-3达0.992,GPT-4o-mini达0.963),但配对F1仅为0.51–0.57(LLaMA-3)与0.53(GPT-4o-mini),置信区间与混合方法无交集。结论:将实体抽取与确定性日期计算分离,优于直接生成,在未见动作上仍具泛化能力,并暴露失败模式。下一步需在真实电子病历数据上验证。
原文摘要 · Abstract (English)
Objective. Outpatient notes carry follow-up instructions pairing actions with future times ("MRI brain in two weeks"). Extracting (action, date) pairs supports scheduling and audit, but generative extractors miss the date because linking and arithmetic are implicit in decoding. We test a hybrid neural-symbolic pipeline against direct generation. Methods. We define TestSpecification and TimeSpecification entities and a ScheduledFor relation. BioBERT feeds BIO tagging and a biaffine linker; entities are canonicalized via a 28-action ontology and times normalized to day offsets deterministically. We evaluate on a 2,000-note synthetic outpatient corpus with action-disjoint splits (18 train, 6 OOV-test) against zero-shot GPT-4o-mini and LoRA-fine-tuned LLaMA-3 8B with note-level bootstrap 95% CIs. Results. On 259-note seen and OOV splits the hybrid pipeline achieves Test-Time Pair F1 of 0.997 and 0.986 with 0.00-day MAE. Baselines reach high action F1 (LLaMA-3 0.992; GPT-4o-mini 0.963 seen) but Pair F1 stays at 0.51-0.57 (LLaMA-3) and 0.53 (GPT-4o-mini), CIs non-overlapping with the hybrid. Conclusion. Separating learned entity extraction from deterministic date arithmetic outperforms generation on this benchmark, generalizes to held-out actions, and exposes failure modes. Transfer to real EHR notes is the next validation; a first-pass realism check is in Limitations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。