用强化学习让学术论文变易懂,降级六年级阅读难度
Science Out of Its Ivory Tower: Improving Accessibility with Reinforcement Learning
- 用奖励机制引导模型替换专业术语,提升可读性
- 使论文可读性提升约90%,达到高中水平
- 适合科普传播、教育推广和非专业人士阅读
每天有大量学术成果发表,但因术语密集、语言复杂,公众难以理解。为此,我们提出一种基于强化学习的框架,微调语言模型将学术摘要重写为更易懂版本。通过平衡词级与句级可读性奖励,模型有效将技术术语替换为更通俗表达,而传统监督微调或可读性指标指导的方法难以实现此目标。最佳模型使摘要可读性降低约六个美国年级等级——从研究生水平降至高中水平,相比监督微调基线相对提升约90%,同时保持事实准确性和语言质量。深入分析表明,均衡奖励促使模型系统性改写,优化更平滑,性能更优。该工作旨在缩小学术研究与公众之间的鸿沟,尤其惠及年轻读者及非高等教育人群。
原文摘要 · Abstract (English)
A vast amount of scholarly work is published daily, yet much of it remains inaccessible to the general public due to dense jargon and complex language. To address this challenge in science communication, we introduce a reinforcement learning framework that fine-tunes a language model to rewrite scholarly abstracts into more comprehensible versions. Guided by a carefully balanced combination of word- and sentence-level accessibility rewards, our language model effectively substitutes technical terms with more accessible alternatives, a task which models supervised fine-tuned or guided by conventional readability measures struggle to accomplish. Our best model adjusts the readability level of scholarly abstracts by approximately six U.S. grade levels -- in other words, from a postgraduate to a high school level. This translates to roughly a 90% relative boost over the supervised fine-tuning baseline, all while maintaining factual accuracy and high-quality language. An in-depth analysis of our approach shows that balanced rewards lead to systematic modifications in the base model, likely contributing to smoother optimization and superior performance. We envision this work as a step toward bridging the gap between scholarly research and the general public, particularly younger readers and those without a college degree.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。