arXiv:2601.11522cs.CV2026-01被引 2

UniX统一胸部X光理解与生成,性能媲美专用模型。

UniX: Unifying Autoregression and Diffusion for Chest X-Ray Understanding and Generation

  • 分设自回归与扩散分支,分别专注理解与生成。
  • 理解性能提升46.1%(微平均F1),生成质量提升24.2%(FD-RadDino)。
  • 参数量仅为LLM-CXR的1/4,适合医疗影像通用建模。

尽管取得进展,医学基础模型仍难以统一视觉理解与生成任务,因二者目标冲突:语义抽象与像素级重建。现有基于参数共享自回归架构的方法常导致任务表现妥协。为此,我们提出UniX——下一代胸部X光统一医学基础模型。UniX将理解与生成解耦为自回归分支与扩散分支,并引入跨模态自注意力机制,动态利用理解特征引导生成。结合严格的清洗流程与多阶段训练策略,该架构实现任务协同,充分发挥扩散模型优势。在两个代表性基准上,UniX在理解性能(微平均F1)上提升46.1%,生成质量(FD-RadDino)提升24.2%,仅用四分之一参数量即达到与专用模型相当的性能,建立可扩展的医学图像理解与生成协同范式。代码与模型见https://github.com/ZrH42/UniX。

原文摘要 · Abstract (English)

Despite recent progress, medical foundation models still struggle to unify visual understanding and generation, as these tasks have inherently conflicting goals: semantic abstraction versus pixel-level reconstruction. Existing approaches, typically based on parameter-shared autoregressive architectures, frequently lead to compromised performance in one or both tasks. To address this, we present UniX, a next-generation unified medical foundation model for chest X-ray understanding and generation. UniX decouples the two tasks into an autoregressive branch for understanding and a diffusion branch for high-fidelity generation. Crucially, a cross-modal self-attention mechanism is introduced to dynamically guide the generation process with understanding features. Coupled with a rigorous data cleaning pipeline and a multi-stage training strategy, this architecture enables synergistic collaboration between tasks while leveraging the strengths of diffusion models for superior generation. On two representative benchmarks, UniX achieves a 46.1% improvement in understanding performance (Micro-F1) and a 24.2% gain in generation quality (FD-RadDino), using only a quarter of the parameters of LLM-CXR. By achieving performance on par with task-specific models, our work establishes a scalable paradigm for synergistic medical image understanding and generation. Codes and models are available at https://github.com/ZrH42/UniX.

医学影像生成模型统一建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。