arXiv:2607.19115cs.CV2026-07

用最优传输重排序3D场景,精准匹配语言修改后的房间检索。

CR-Refiner: An Object-Centric Optimal Transport Reranker for Edit-Conditioned 3D Scene Retrieval

论文配图:CR-Refiner: An Object-Centric Optimal Transport Reranker for Edit-Conditioned 3D Scene Retrieval
图 1 · 摘自论文原文
  • 基于未平衡最优传输,对候选场景中物体的类别、风格等属性进行动态匹配。
  • 在五个编辑维度上,硬子集R@1提升18.7%,mAP@10提升12.3%。
  • 无需训练,适配任意基线检索器,适合需要精确场景编辑的下游任务。

编辑条件下的3D场景检索需将参考3D房间与自然语言修改结合,从语料库中找出满足修改的房间。现有三类方法各有不足:2D图像检索依赖像素级编辑,缺乏3D物体集合的建模能力;3D基础编码器仅能嵌入单个物体,无法实现场景级组合;3D场景定位方法仅在静态场景内定位,无法跨语料库排序修改后的房间。本文提出CR-Refiner,一种无需训练的重排序器,可封装任意基检索器的前K个候选结果。其包含三个组件:冻结大模型解析编辑为结构化查询实体;通过1×G成本矩阵(含类别、风格、材质、几何)构建非平衡最优传输问题,允许单实体查询忽略无关对象,直接建模不对称性;轴向条件结构先验引入尺寸关键词提示几何修改,主体-锚点方向提示空间修改;最后由大模型验证器对前三名候选进行连续置信度优化。因无基准评估3D物体集合的组合匹配,我们额外发布3D-CER数据集,包含4,963条编辑条件查询,覆盖23,381个室内房间,涵盖五种编辑轴,提供多正例真值、类CIRR硬子集及零目标对抗样本。在三种不同基线检索器上,CR-Refiner在所有编辑轴上均显著提升硬子集R@1和mAP@10。

原文摘要 · Abstract (English)

Edit-conditioned 3D scene retrieval pairs a reference 3D room with a natural-language modification and retrieves rooms from a corpus that satisfy the edit. Three lines of prior work each fall short on this task. 2D composed image retrieval reasons over pixel-level edits and has no primitive for 3D object sets. 3D foundation encoders embed individual objects but cannot compose at the scene level. 3D scene-grounding methods localize references inside a static scene rather than rank modified rooms across a corpus. We present CR-Refiner, a training-free reranker that wraps any base retriever's top-K candidates with three components. A frozen LLM parses the edit into a structured query entity, and each candidate is scored by an unbalanced optimal-transport problem over a 1xG cost matrix coupling category, style, material, and geometry. The unbalanced solver lets the single-entity query drop mass on irrelevant objects, modelling the asymmetry directly. An axis-conditional structural prior adds size-keyword cues for geometric edits and subject-anchor direction cues for spatial edits. An LLM verifier refines the top three candidates with continuous confidence. Because no benchmark evaluates compositional matching over 3D object sets, we additionally release 3D-CER, 4,963 edit-conditioned queries over a 23,381-room indoor corpus across five edit axes, with multi-positive ground truth, CIRR-style hard subsets, and zero-target adversarials. Across three qualitatively distinct base retrievers, CR-Refiner consistently improves hard-subset R@1 and mAP@10 on every edit axis.

3D检索最优传输语言编辑场景生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。