arXiv:2608.28595cs.AIcs.CL2026-08中稿 · the 2026 14th Inte…

为医学文本分类设计可审计的保守纠错层,避免误改关键术语。

The Signal in the Noise: An Auditable Reliability Layer for Biomedical Text Classification

  • 基于编辑距离与生物医学词频的确定性纠错,不确定时直接跳过
  • 在2104个样本上修复94.61%错误,零误改安全控制样本
  • 恢复噪声导致80.45%性能损失,适合对可靠性要求高的医疗场景

生物医学自然语言处理流程通常假设输入文本干净,但大规模自动解析的PDF语料常包含类似OCR的错误、分词错位、连字符残留和字符级损坏,系统性削弱词汇证据并降低下游分类器性能。本文提出一种保守的、完全可审计的拼写纠错可靠性层,作为以安全为导向的预处理模块而非追求最大准确率的校正器:在不确定性条件下,系统主动放弃编辑,遵循医学‘不伤害’原则。该确定性架构结合有界编辑距离候选生成、语料库衍生n-gram评分及一系列生物医学安全门控机制,保护领域关键术语。我们在人工标注的2,104个词级案例上进行内在评估,并在涵盖10,000例的CORD-19三分类任务(预防、治疗、流行病学)中通过四轮协议(洁净、噪声、还原、安全)进行外在评估。内在评估显示,该层在合成错误中实现94.61%的错误修复召回率,且在负控样本中零误改。外在评估表明,它恢复了约80.45%由噪声引起的宏平均F1下降,使宏平均F1从噪声情况下的0.7654提升至还原后的0.7717,同时保持接近洁净水平的性能(安全:0.7721)。对103个真实OCR提取摘要的补充案例研究显示,BioBERT等变换器编码器对轻度噪声相对鲁棒,启发未来可集成有界神经信号与UMLS词典的灰盒架构,同时不牺牲可审计性。系统完全确定性、以数据缺陷驱动,专为部署与审计设计。

原文摘要 · Abstract (English)

Biomedical NLP pipelines routinely presuppose clean input text, yet large-scale corpora assembled through automated PDF parsing harbour pervasive OCR-like artifacts, token splits and merges, hyphenation remnants, and character-level corruption, that systematically erode lexical evidence and degrade downstream classifiers. We introduce a conservative, fully auditable spell-correction reliability layer conceived as a safety-oriented preprocessing module rather than a maximal-accuracy corrector: under conditions of uncertainty, the system abstains from editing, in accordance with a medical do-no-harm philosophy. The deterministic architecture couples bounded edit-distance candidate generation with corpus-derived n-gram scoring and a suite of biomedical safety gates that protect domain-critical terminology. We evaluate the layer both intrinsically, on a manually curated benchmark of 2,104 token-level cases, and extrinsically, on a tri-class CORD-19 topic classifier (Prevention, Treatment, Epidemiology) spanning 10,000 examples under a principled four-run protocol (Clean, Noisy, Restored, Safety). Intrinsically, the layer attains 94.61% error-fix recall on synthetic errors with zero harmful edits on negative controls. Downstream, it recovers approximately 80.45% of the noise-induced macro-F1 degradation, elevating macro-F1 from 0.7654 (Noisy) to 0.7717 (Restored) while preserving near-clean performance (Safety: 0.7721). A supplementary case study on 103 real-world OCR-extracted abstracts classified with BioBERT confirms that transformer encoders appeared relatively robust to mild noise, motivating a future grey-box architecture that integrates bounded neural signals and UMLS lexicons without compromising auditability. The system is fully deterministic, artifact-driven, and designed with deployment and auditability in mind.

医学NLP纠错可审计性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。