arXiv:2507.01479cs.CLcs.AI2025-07

用用户偏好优化模型,让AI简化文字更贴合智力障碍者需求。

Evaluating the Effectiveness of Direct Preference Optimization for Personalizing German Automatic Text Simplifications for Persons with Intellectual Disabilities

  • 用直接偏好优化技术,基于障碍者反馈改进文本简化模型。
  • 实测表明,加入用户偏好后简化文本更受目标群体欢迎。
  • 适合关注无障碍AI、个性化辅助系统的研究者与开发者。

自动文本简化(ATS)旨在提升各类人群的语言可及性,尤其服务于智力障碍者。近年来,生成式AI尤其是大语言模型(LLMs)显著提升了机器生成简化文本的质量,缓解了信息获取障碍。然而,现有基于LLM的ATS系统在训练中未纳入对简化文本的偏好反馈,缺乏针对目标群体需求的个性化。本文通过扩展标准监督微调(SFT)方法,采用计算高效的直接偏好优化(DPO)技术,利用智力障碍者对主流LLM生成的成对简化文本的偏好反馈进行模型后训练。同时提出一套完整个性化ATS系统开发流程,涵盖数据收集、模型选择、SFT与DPO后训练及评估。研究结果强调,目标群体成员积极参与设计,是实现符合人类期望的个性化无障碍AI的关键。本工作推动了面向特定群体的包容性AI系统个性化进程,不仅融合文本简化专家见解,更纳入目标群体自身的声音。

原文摘要 · Abstract (English)

Automatic text simplification (ATS) aims to enhance language accessibility for various target groups, particularly persons with intellectual disabilities. Recent advancements in generative AI, especially large language models (LLMs), have substantially improved the quality of machine-generated text simplifications, thereby mitigating information barriers for the target group. However, existing LLM-based ATS systems do not incorporate preference feedback on text simplifications during training, resulting in a lack of personalization tailored to the specific needs of target group representatives. In this work, we extend the standard supervised fine-tuning (SFT) approach for adapting LLM-based ATS models by leveraging a computationally efficient LLM alignment technique -- direct preference optimization (DPO). Specifically, we post-train LLM-based ATS models using human feedback collected from persons with intellectual disabilities, reflecting their preferences on paired text simplifications generated by mainstream LLMs. Furthermore, we propose a pipeline for developing personalized LLM-based ATS systems, encompassing data collection, model selection, SFT and DPO post-training, and evaluation. Our findings underscore the necessity of active participation of target group persons in designing personalized AI accessibility solutions aligned with human expectations. This work represents a step towards personalizing inclusive AI systems at the target-group level, incorporating insights not only from text simplification experts but also from target group persons themselves.

文本简化无障碍AI个性化大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。