arXiv:2608.07299cs.CVcs.AI2026-08

让模型从报告中自动识别病灶并精准分割,无需预设目标。

EliSeg: Verified Target Construction for Report-Grounded Abnormality Segmentation

论文配图:EliSeg: Verified Target Construction for Report-Grounded Abnormality Segmentation
图 1 · 摘自论文原文
  • 三阶段框架:先构想目标,再验证合法性,最后修正不一致
  • 在MIMIC-CXR-ILS上各项指标均优于现有方法,误检率显著降低
  • 适合临床报告理解与医学图像分割交叉研究者使用

放射科报告描述临床发现,但未明确可执行的分割目标。报告中可能包含存在、否定、既往、不确定或无关的病灶,且多个有效异常可能共存。现有分割方法通常通过预设目标身份或空间提示绕过这种模糊性,相当于依赖隐含的目标指引。本文研究报告引导的异常分割任务,要求模型在推理前直接从未经过滤的报告中判断目标有效性、数量及病灶与掩码的对应关系。我们提出EliSeg,一种“构想-验证-修正”框架,将目标构建与掩码生成结合:语法约束的演员(Actor)提出目标槽和掩码,独立的文本验证器(Verifier)重建合法病灶清单,当两者结构不一致时,修订模块选择性重新执行共享演员。EliSeg无需预先定义目标身份、病灶提示、点或边界框。在MIMIC-CXR-ILS上的实验表明,EliSeg在各类病灶上持续优于直接分割方法和提取-分割级联模型,有效抑制了对无效报告提及的错误掩码。消融实验验证了验证与修订的互补作用;在CheXlocalize上的评估显示EliSeg具备良好跨数据集迁移能力。代码已公开于https://github.com/Maybach-dream/EliSeg。

原文摘要 · Abstract (English)

Radiology reports describe clinical observations but do not specify executable segmentation targets. They may contain present, negated, prior,uncertain, or irrelevant findings, while multiple valid abnormalities may coexist. Existing segmentation methods largely bypass this ambiguity by receiving a target identity or spatial prompt before inference, which acts as a hidden target oracle. We study report-grounded abnormality segmentation, where a model must determine target eligibility, cardinality, and finding-to-mask correspondence directly from an unfiltered report before delineating the corresponding regions. We propose \textbf{EliSeg}, an atcor--verify--revise framework that integrates target construction with mask generation. A grammar-constrained Actor proposes target slots and masks, an independent text-only Verifier reconstructs the eligible finding inventory, and Revision selectively re-executes the shared Actor when their target structures disagree. EliSeg requires no predefined target identity, finding prompt, point, or bounding box. Experiments on MIMIC-CXR-ILS show that EliSeg consistently outperforms direct segmentation methods and extract-then-segment cascades across findings, while effectively suppressing masks for ineligible report mentions. Ablation studies confirm the complementary roles of verification and revision, and evaluation on CheXlocalize demonstrates effective transfer of the EliSeg to an external dataset.Code is available at https://github.com/Maybach-dream/EliSeg.

医学图像报告理解分割多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。