arXiv:2606.31800cs.AI2026-06ACL被引 1

通过动态演化推理原则,提升医疗多模态模型的决策能力。

Evo-PI: Aligning Medical Reasoning via Evolving Principle-Guided Supervision

论文配图:Evo-PI: Aligning Medical Reasoning via Evolving Principle-Guided Supervision
图 1 · 摘自论文原文
  • 用可迭代演化的语言原则替代固定提示,引导模型推理
  • 在8个医学视觉问答任务中,最高提升24.6%的推理准确率
  • 适合需要严谨逻辑推理的高风险领域如医疗AI

尽管近期取得进展,大型多模态语言模型(MLLMs)的推理能力仍受限于静态监督——固定的提示、规则或奖励模型在训练中提供不变指导。这类静态信号虽能约束输出格式,却难以塑造深层推理过程,导致复杂决策任务中泛化能力差、性能饱和。我们提出Evo-PI,一种以原则为中心的学习框架,将推理原则作为显式的语言监督信号,可生成、评估并迭代演化。Evo-PI实现原则与模型行为的共演化:原则指导模型推理,模型表现又反向优化原则,使监督随模型缺陷动态调整。我们在医疗视觉问答这一高风险场景中验证该方法,涵盖八个基准和多种模型骨干网络。结果表明,Evo-PI持续提升推理准确率,最高达24.6%。研究显示,演化式原则引导监督为训练专家对齐的推理能力提供了可扩展且通用的新范式。代码已开源:https://github.com/zhengxianda/Evo_PI。

原文摘要 · Abstract (English)

Despite recent progress, the reasoning capabilities of large multimodal language models (MLLMs) remain fundamentally constrained by static supervision, where fixed prompts, rules, or reward models provide non-adaptive guidance throughout training. Such static signals are often sufficient to enforce output formats, but fail to shape the underlying reasoning process, leading to brittle generalization and performance saturation in complex decision-making tasks. We propose Evo-PI, a principle-centric learning framework that treats reasoning principles as explicit, language-based supervision signals that can be generated, evaluated, and iteratively evolved. Instead of relying on fixed rewards, Evo-PI enables a co-evolutionary loop in which principles guide model reasoning, while model behaviors in turn refine the principles that supervise them. This dynamic alignment mechanism allows supervision to progressively adapt to the model's reasoning deficiencies. We instantiate Evo-PI in medical visual question answering as a high-stakes testbed requiring structured visual-textual reasoning. Across eight benchmarks and multiple model backbones, Evo-PI consistently improves reasoning accuracy, achieving gains of up to 24.6%. Our results suggest that evolving principle-guided supervision offers a scalable and general paradigm for training expert-aligned reasoning in MLLMs. Code is available at https://github.com/zhengxianda/Evo_PI.

医疗AI多模态推理增强动态监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。