医学文本跨语言对齐模型,精准翻译临床实体标注
ClinicalAligner26AM: A Cross-Lingual Aligner for Dataset Translation; Evidences from the MultiClinCorpus Shared Task

- 融合句、词、字三级信号,用最优传输优化对齐目标
- 在多语言临床数据集上实现超95%字符加权F1分数
- 适合医学信息翻译与跨语言标注质量评估场景
词级跨语言对齐是注释投影、翻译审计和跨语言忠实度估计的核心,但现有神经对齐模型很少适配专业领域。本文提出ClinicalAligner26AM,一种基于ClinicalEncoder26AM初始化的大上下文多语言对齐模型。训练受AWESoME Align启发,通过融合句级、短语级和词级信号构建平行临床文本的代价矩阵,并利用Sinkhorn-Knop最优传输进行锐化,生成软对齐目标。将此锐化对齐矩阵直接蒸馏至学生模型,使其朴素余弦相似度匹配目标。推理时,通过学习到的词对齐矩阵投影源端得分,并解码目标文本中最长有效高分段,可选地结合附录B中的MultiClinNER预测。在MultiClinCorpus共享任务上评估,该模型将西班牙语临床实体标注投影至六种目标语言,两个提交系统在所有语言和实体类型中分别排名第一和第二,近似所有设置下字符加权F1超过0.95。
原文摘要 · Abstract (English)
Word-level cross-lingual alignment is central to annotation projection, translation auditing, and cross-lingual faithfulness estimation, yet existing neural aligners are rarely adapted to specialized domains. In this paper, we introduce ClinicalAligner26AM, a large-context multilingual aligner model for biomedical and clinical text initialized from ClinicalEncoder26AM. Our training recipe is inspired by AWESoME Align. We build our soft alignment target by sharpening with Sinkhorn-Knop optimal transport a cost matrix established for parallel clinical texts and conversations through the fusion of sentence-level, phrase-level, and token-level signals. We distill this sharpened alignment matrix directly into our student aligner, by encouraging its naive cosine-based token similarity scores to match this target. At inference time, we project source-span scores through the learned token alignment matrix and decode the longest valid high-scoring span in the target text, optionally supported by MultiClinNER predictions summarized in Appendix B. We evaluate CA26AM on the MultiClinCorpus shared task, which projects Spanish clinical entity annotations into six target languages. Our two submitted systems ranked respectively first and second across all languages and entity types, with character-weighted F1 scores above 0.95 in nearly all settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。