arXiv:2411.13518cs.CLcs.AI2024-11被引 1

专为阿拉伯语医疗文本优化的模型,显著优于现有水平。

Advancing Complex Medical Communication in Arabic with Sporo AraSum: Surpassing Existing Large Language Models

  • 针对阿拉伯语医疗文本设计,兼顾语法与文化敏感性
  • 在摘要准确性和临床实用性上全面超越现有模型
  • 适合需要高精度阿拉伯语医疗AI的医疗机构使用

医疗领域对多语言能力的需求日益增长,亟需能够处理多种语言的AI模型,尤其是在临床文档和决策中。阿拉伯语因其复杂的形态、句法和方言差异,在医疗NLP中面临独特挑战。本案例研究评估了专为阿拉伯语临床文档设计的Sporo AraSum模型,对比当前领先的阿拉伯语NLP模型JAIS。通过合成数据集及自定义的PDQI-9指标,重点评估模型在总结患者-医生对话中的表现,包括准确性、完整性、临床效用和语言文化适配性。结果表明,Sporo AraSum在人工智能主导的定量指标及所有定性评估维度上均显著优于JAIS。其架构能实现精准且具有文化敏感性的记录,有效应对阿拉伯语的语言细微差别,降低AI幻觉风险。研究显示Sporo AraSum更适用于阿拉伯语医疗环境,可为多语言临床流程提供变革性解决方案。未来研究应引入真实世界数据进一步验证,并探索在医疗系统中的广泛应用。

原文摘要 · Abstract (English)

The increasing demand for multilingual capabilities in healthcare underscores the need for AI models adept at processing diverse languages, particularly in clinical documentation and decision-making. Arabic, with its complex morphology, syntax, and diglossia, poses unique challenges for natural language processing (NLP) in medical contexts. This case study evaluates Sporo AraSum, a language model tailored for Arabic clinical documentation, against JAIS, the leading Arabic NLP model. Using synthetic datasets and modified PDQI-9 metrics modified ourselves for the purposes of assessing model performances in a different language. The study assessed the models' performance in summarizing patient-physician interactions, focusing on accuracy, comprehensiveness, clinical utility, and linguistic-cultural competence. Results indicate that Sporo AraSum significantly outperforms JAIS in AI-centric quantitative metrics and all qualitative attributes measured in our modified version of the PDQI-9. AraSum's architecture enables precise and culturally sensitive documentation, addressing the linguistic nuances of Arabic while mitigating risks of AI hallucinations. These findings suggest that Sporo AraSum is better suited to meet the demands of Arabic-speaking healthcare environments, offering a transformative solution for multilingual clinical workflows. Future research should incorporate real-world data to further validate these findings and explore broader integration into healthcare systems.

医疗AI阿拉伯语自然语言处理临床文档

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。