arXiv:2601.09136cs.CVcs.AI2026-01被引 1

用动态视觉编码和分阶段强化学习提升皮肤病诊断效率

SkinFlow: Efficient Information Transmission for Open Dermatological Diagnosis via Dynamic Visual Encoding and Staged RL

  • 通过动态视觉编码器在不增加参数量的情况下展开病变特征
  • 7B模型在Fitzpatrick17k上顶1准确率提升12.06%,顶6准确率提升28.57%
  • 适合关注医疗AI效率与可解释性的研究者和临床开发者

通用大视觉语言模型因存在“泛化注意力”问题,难以区分皮肤病变与背景噪声。本文提出SkinFlow框架,将诊断视为视觉信息传输效率的优化过程。采用虚拟宽度动态视觉编码器(DVE)在不物理扩展参数的前提下“展开”复杂病变结构,并引入两阶段强化学习策略:第一阶段对齐显式医学描述,第二阶段在受限语义空间中重建隐式诊断纹理。同时设计基于临床需求的评估协议,优先考虑诊断安全性和层级相关性。实验证明,7B规模模型在Fitzpatrick17k基准上取得新纪录,顶1准确率较Qwen3VL-235B和GPT-5.2等大规模模型提升12.06%,顶6准确率提升28.57%。结果表明,优化几何容量与信息流优于单纯参数扩展。

原文摘要 · Abstract (English)

General-purpose Large Vision-Language Models (LVLMs), despite their massive scale, often falter in dermatology due to "diffuse attention" - the inability to disentangle subtle pathological lesions from background noise. In this paper, we challenge the assumption that parameter scaling is the only path to medical precision. We introduce SkinFlow, a framework that treats diagnosis as an optimization of visual information transmission efficiency. Our approach utilizes a Virtual-Width Dynamic Vision Encoder (DVE) to "unfold" complex pathological manifolds without physical parameter expansion, coupled with a two-stage Reinforcement Learning strategy. This strategy sequentially aligns explicit medical descriptions (Stage I) and reconstructs implicit diagnostic textures (Stage II) within a constrained semantic space. Furthermore, we propose a clinically grounded evaluation protocol that prioritizes diagnostic safety and hierarchical relevance over rigid label matching. Empirical results are compelling: our 7B model establishes a new state-of-the-art on the Fitzpatrick17k benchmark, achieving a +12.06% gain in Top-1 accuracy and a +28.57% boost in Top-6 accuracy over the massive general-purpose models (e.g., Qwen3VL-235B and GPT-5.2). These findings demonstrate that optimizing geometric capacity and information flow yields superior diagnostic reasoning compared to raw parameter scaling.

皮肤病诊断视觉编码强化学习模型效率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。