arXiv:2603.21083cs.CV2026-03

用分层文本提示提升脑肿瘤分割精度,精准捕捉不同病灶区域特征。

Hierarchical Text-Guided Brain Tumor Segmentation via Sub-Region-Aware Prompts

  • 分步预测整体、核心与增强区域,符合解剖层级关系。
  • 在TextBraTS上Dice提升1.7%,HD95降低6%,优于当前最佳方法。
  • 适合医学影像与临床报告融合分析的研究者使用。

脑肿瘤分割因整体肿瘤(WT)、肿瘤核心(TC)和增强肿瘤(ET)三类区域视觉边界模糊而困难。现有跨模态方法通常将放射科描述文本压缩为单一全局嵌入,忽略了各子区域的临床差异。本文提出TextCSP框架,包含三个新组件:(1) 文本调制的软级联解码器,按粗到细顺序预测WT→TC→ET,符合解剖包含关系;(2) 子区域感知提示调优,采用LoRA适配的BioBERT编码器生成各区域专用文本表示;(3) 文本语义通道调制器,将文本表示转化为通道级优化信号,引导解码器强化与临床描述一致的特征。在TextBraTS数据集上的实验表明,该方法在所有子区域上均优于现有先进方法,主要指标Dice提升1.7%,HD95降低6%。

原文摘要 · Abstract (English)

Brain tumor segmentation remains challenging because the three standard sub-regions, i.e., whole tumor (WT), tumor core (TC), and enhancing tumor (ET), often exhibit ambiguous visual boundaries. Integrating radiological description texts with imaging has shown promise. However, most multimodal approaches typically compress a report into a single global text embedding shared across all sub-regions, overlooking their distinct clinical characteristics. We propose TextCSP (text-modulated soft cascade architecture), a hierarchical text-guided framework that builds on the TextBraTS baseline with three novel components: (1) a text-modulated soft cascade decoder that predicts WT->TC->ET in a coarse-to-fine manner consistent with their anatomical containment hierarchy. (2) sub-region-aware prompt tuning, which uses learnable soft prompts with a LoRA-adapted BioBERT encoder to generate specialized text representations tailored for each sub-region; (3) text-semantic channel modulators that convert the aforementioned representations into channel-wise refinement signals, enabling the decoder to emphasize features aligned with clinically described patterns. Experiments on the TextBraTS dataset demonstrate consistent improvements across all sub-regions against state-of-the-art methods by 1.7% and 6% on the main metrics Dice and HD95.

脑肿瘤分割多模态学习提示调优医学影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。