arXiv:2605.02266cs.CLcs.AI2026-05

针对多语言骨科诊断,提出适配专用模型与验证框架以提升可靠性。

Reliability-Oriented Multilingual Orthopedic Diagnosis: A Domain-Adaptive Modeling and a Conceptual Validation Framework

论文配图:Reliability-Oriented Multilingual Orthopedic Diagnosis: A Domain-Adaptive Modeling and a Conceptual Validation Framework
图 1 · 摘自论文原文
  • 设计领域自适应模型IndicBERT-HPA,融合语言特异性适配头提升跨语言识别。
  • 在六类骨科诊断中,该模型表现稳定,置信度更可预测,优于通用大模型。
  • 提出基于确定性代理的验证框架,支持语言敏感校验与人机协同决策。

大型语言模型(LLMs)在低资源环境下的多语言临床决策支持中日益受到关注,但其在结构化高风险任务中的可靠性、校准性和安全性仍不明确。本文对英文、印地语和旁遮普语自由文本病历中的多语言骨科诊断进行系统分析,评估三种建模方式:(i) 任务对齐的多语言变压器编码器,(ii) 任务微调基线(DistilBERT),(iii) 针对骨科文本定制的领域自适应架构(IndicBERT-HPA)。对比零样本指令微调大模型,结果表明:尽管大模型语言流畅,但在结构化多语言条件下表现出不稳定的校准和降低的可靠性,尤其在低资源语言中更为明显。这些发现限于零样本设置,不否定微调模型的潜力。领域自适应显著提升跨语言判别力与置信度行为。IndicBERT-HPA通过语言特异性骨科适配头,在六类诊断中表现一致优异,部署特性更可预测,优于仅任务适配。基于此,提出概念性确定性代理验证框架,包含证据核查、语言敏感验证与保守的人机协同闸门机制。可靠多语言临床决策支持需专用架构、显式可靠性分析及结构化验证。

原文摘要 · Abstract (English)

Large Language Models (LLMs) are increasingly proposed for clinical decision support including multilingual diagnosis in low-resource settings. However, their reliability, calibration and safety characteristics remain insufficiently understood for structured, high-risk tasks. We present a system-level analysis of multilingual orthopedic diagnosis from free-text clinical notes in English, Hindi and Punjabi. We evaluate three modeling regimes: (i) task-aligned multilingual transformer encoders, (ii) a task-fine-tuned baseline (DistilBERT), and (iii) a domain-adaptive architecture tailored to orthopedic text (IndicBERT-HPA). These models are compared with zero-shot, instruction-tuned LLMs to assess suitability for structured diagnostic classification. Results indicate that while LLMs exhibit strong linguistic fluency, they show unstable calibration and reduced reliability under structured multilingual conditions, particularly in low-resource languages. These findings are specific to zero-shot evaluation and do not imply limitations of fine-tuned models. Domain-adaptive specialization substantially improves cross-lingual discrimination and confidence behavior. IndicBERT-HPA, with language-specific orthopedic adapter heads achieves consistently strong performance across six diagnostic categories and more predictable deployment characteristics than task-only adaptation. Building on these observations, we outline a conceptual deterministic agent-based validation framework for future implementation, formalizing evidence checks, language-sensitive validation and conservative human-in-the-loop gating. Reliable multilingual clinical decision support requires specialized architecture, explicit reliability analysis, and structured validation for safety-critical systems.

多语言诊断骨科医学模型可靠性领域自适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。