arXiv:2607.12602cs.CV2026-07中稿 · MICCAI 2026

将3D肺部CT文本定位分为两阶段,提升医学影像理解准确率。

Decouple and Reason: Anatomically Guided Two-Stage Voxel-Level Grounding of Free-Text Findings in 3D Chest CT

论文配图:Decouple and Reason: Anatomically Guided Two-Stage Voxel-Level Grounding of Free-Text Findings in 3D Chest CT
图 1 · 摘自论文原文
  • 先分割病灶区域,再进行跨模态文本对齐。
  • 在公开数据集上达到最新最佳性能,准确率超现有方法。
  • 利用解剖结构信息解决局部模糊问题,适合医疗影像研究者。

自动实现3D胸部计算机断层扫描(CT)中自由文本发现的体素级定位对临床可解释性至关重要。然而,由于大体积3D数据的空间复杂性和文本描述的异质性,该任务仍极具挑战。现有端到端方法难以同时学习精准的3D分割特征与复杂的语义理解,导致定位性能不佳。为此,我们提出一种解耦式框架,将问题拆分为两个专业化阶段:(1) 无类别病灶分割,(2) 文本-体积极致推理。该结构分离使模型能先提取潜在异常候选体块,再通过跨模态推理将其与自由文本医学发现对齐。为缓解局部区域的空间歧义,推理模块引入显式的解剖引导,利用相对空间坐标和肺叶先验。在ReXGroundingCT基准测试中,本方法在官方排行榜上实现最优整体定位质量。结果表明,将检测与推理解耦是应对3D医学视觉定位复杂性的有效范式。代码已公开于https://github.com/khuhm/DAGG。

原文摘要 · Abstract (English)

Automatic voxel-level grounding of free-text findings in 3D chest Computed Tomography (CT) is critical for clinical interpretability. However, this task remains highly challenging due to the intricate spatial complexity of large 3D volumes and the heterogeneity of free-text findings. Existing end-to-end approaches often struggle to simultaneously learn the localized feature representations required for accurate 3D segmentation and the complex semantic understanding needed for text alignment, leading to suboptimal grounding performance. To overcome this fundamental limitation, we propose a novel decoupled framework that disentangles the problem into two specialized stages: (1) class-agnostic lesion segmentation and (2) text-volume reasoning. This structural separation allows the model to first extract candidate sub-volumes by localizing potential abnormalities. Subsequently, intensive cross-modal reasoning is performed to align these localized sub-volumes with free-text medical findings. To resolve the spatial ambiguities inherent in local regions, the reasoning module is augmented with explicit anatomical guidance, utilizing relative spatial coordinates and lung lobe priors. Evaluated on the ReXGroundingCT benchmark, our method achieves state-of-the-art performance in overall grounding quality on the official leaderboard. These results demonstrate that decoupling detection from reasoning is a highly effective paradigm for handling the complexity of 3D medical visual grounding. Our code is publicly available at https://github.com/khuhm/DAGG.

3D医学影像视觉定位解剖引导跨模态推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。